-- Logs begin at Mon 2022-10-31 14:14:44 UTC, end at Mon 2022-10-31 15:16:15 UTC. -- Oct 31 14:47:49.154988 dv-cinder-860227-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 14:47:49.162326 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 14:47:49 2022] *** Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: nodename: dv-cinder-860227-3-iscsi Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: machine: x86_64 Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: clock source: unix Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: pcre jit disabled Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: detected number of CPU cores: 4 Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: current working directory: / Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: detected binary path: /usr/bin/uwsgi-core Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: your processes number limit is 47680 Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: your memory page size is 4096 bytes Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: detected max file descriptor number: 2048 Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: lock engine: pthread robust mutexes Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: thunder lock: enabled Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 14:47:49.168430 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 14:47:49.204807 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: Python main interpreter initialized at 0x558cce0139c0 Oct 31 14:47:49.204807 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: python threads support enabled Oct 31 14:47:49.204807 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: your server socket listen backlog is limited to 100 connections Oct 31 14:47:49.204807 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: your mercy for graceful operations on workers is 90 seconds Oct 31 14:47:49.205302 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 14:47:49.205302 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: *** Operational MODE: preforking *** Oct 31 14:47:49.205495 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: *** uWSGI is running in multiple interpreter mode *** Oct 31 14:47:49.205495 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: spawned uWSGI master process (pid: 118906) Oct 31 14:47:49.205726 dv-cinder-860227-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 31 14:47:49.207111 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: spawned uWSGI worker 1 (pid: 118907, cores: 1) Oct 31 14:47:49.207111 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: spawned uWSGI worker 2 (pid: 118908, cores: 1) Oct 31 14:47:49.207111 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 14:47:49.870262 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 14:47:49.989002 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 14:47:50.953308 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:47:50.953308 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: from cryptography.utils import int_from_bytes Oct 31 14:47:50.953941 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:47:50.953941 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: from cryptography.utils import int_from_bytes Oct 31 14:47:51.271009 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:47:51.271009 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: from cryptography.utils import int_from_bytes Oct 31 14:47:51.271673 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:47:51.271673 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: from cryptography.utils import int_from_bytes Oct 31 14:47:53.466305 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 14:47:53.467012 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 14:47:53.467120 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 14:47:53.467399 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 14:47:53.467673 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 14:47:53.468054 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.468369 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.468681 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.468991 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.469311 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.469613 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.469919 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.470229 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.470547 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.470799 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.471104 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.471421 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860227-3-iscsi {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.471770 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.472051 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.472352 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.472659 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.472954 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.473266 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.473676 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.474064 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.474547 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.474803 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.475109 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.475440 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.475775 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.476077 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.476387 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.476689 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.477001 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.477301 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.477689 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860227-3-iscsi {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.477998 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.478302 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.478613 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.479007 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.479309 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.479628 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.480511 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.480827 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.481129 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.481449 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.481936 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.482363 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.482678 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.482975 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.483277 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.483611 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.483911 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.484209 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.484510 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.484752 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.485051 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.485364 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.485679 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.485993 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.486237 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.486478 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.486789 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.487104 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.487397 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.487718 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.488018 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.488317 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.488616 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.488912 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.489207 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.489508 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.489815 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.490119 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.490433 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.490731 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.491041 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.491429 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.491711 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.491996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.492326 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.492638 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.492956 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.493245 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.493558 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.493861 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.494153 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.494452 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.494762 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.495085 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.495676 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.495937 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.496239 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.496558 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.496853 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.497155 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.497453 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.497751 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.498045 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.498361 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.498638 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.498937 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.499252 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.499539 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.499853 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.500148 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.500445 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.500739 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.501034 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.501345 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.501661 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.501955 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.502251 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.502547 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.502844 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.503154 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.503450 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.503769 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.504081 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.504381 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.504674 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.504982 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.505277 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.505578 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.505886 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.506178 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.506473 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.506782 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.507077 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.507372 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.507688 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.507986 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.508281 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.508576 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.508897 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.509162 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.509452 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.509761 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.510073 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.510374 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.510671 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.511008 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.511324 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:53.511674 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.511999 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.512336 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.512643 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.512966 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.513293 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.513599 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.513901 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.514205 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.514525 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.514827 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.515130 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.515432 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.515769 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.516086 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.516405 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.516712 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.517020 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.517330 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.517632 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.517948 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.518266 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.518585 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.518887 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.519216 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.519589 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.519881 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.520197 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.520512 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.520813 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.521120 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.521435 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.521749 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.522054 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.522356 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.522667 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.522971 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.523285 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.523606 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.523911 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.524212 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.524514 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.524813 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.525142 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.525449 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.525767 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.526074 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.526381 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.527306 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.528067 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.528067 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.528321 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.528613 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.528917 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.529219 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.529522 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.529821 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.530137 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.530456 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.530759 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.531087 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.531387 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.531712 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.532019 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.532323 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.532623 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.532927 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.533230 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.533528 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.533845 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.534149 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.534450 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.534767 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.535067 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.535366 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.536697 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.536697 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.536697 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.536697 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.537197 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.537197 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.537459 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.537761 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.538088 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.538412 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.538712 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.539028 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.539345 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.539695 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.539996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.540297 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.540595 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.540893 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.541192 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.541492 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.541789 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.542084 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.543026 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.543328 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.543648 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.543969 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.544271 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.544574 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.544875 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.545171 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.545509 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.545811 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.546146 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.546471 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.546783 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.547096 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.547401 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.547735 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.548041 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.548345 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.548647 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.548950 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.549271 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.549566 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.549876 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.550178 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.550495 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.550797 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.551110 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.551408 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.551738 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.552069 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.552394 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.552704 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.553018 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.553321 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.553626 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.553927 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.554228 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.554529 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.554830 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.555140 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.555445 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.555776 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.556082 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.556395 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.556716 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.557008 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.557305 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.557610 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.558010 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.558334 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.558643 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.558948 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.559261 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.559593 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.559887 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.560193 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.560803 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.561110 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.561416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.561725 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.562029 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.562331 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.562630 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.562937 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.563238 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.563535 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.563853 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.564157 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.564470 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.564775 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.565088 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.565403 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.565699 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.565998 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.566311 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.566610 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.566906 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.567203 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.567498 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.567853 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.568157 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.568451 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.568758 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.569069 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.569370 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.569678 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.569979 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.570279 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.570591 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.570896 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.571197 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.571497 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.571821 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.572123 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.572426 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.572738 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.573039 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.573343 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.573843 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.574147 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.574453 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.574762 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.575327 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.575678 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.575988 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.576298 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.576636 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.576949 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.577271 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.577588 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.577894 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.578193 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.578495 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.578793 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.579092 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.579394 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.579710 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.580011 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.580308 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.580610 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.580908 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.581205 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.581503 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.581800 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.582107 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.582406 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.582708 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.583006 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.583318 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.583642 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.584208 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.584503 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.584799 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.585132 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.585428 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.585763 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.586082 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.586417 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.586715 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.587014 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.587329 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.587654 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.587956 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.588253 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.588556 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.588857 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.589669 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.589973 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.590276 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.590578 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.590878 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.591173 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.591473 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.591792 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.592128 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.592428 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.592687 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.592982 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.593283 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.593584 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.593880 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.594180 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.594476 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.594784 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.595080 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.595376 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.595700 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.596006 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.596307 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.596605 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.596918 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.597222 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.597519 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.597815 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.598115 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.598411 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.598707 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.599008 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.599322 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.599656 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.599957 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.600259 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.600555 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.600853 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.601149 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.601448 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.601742 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.602037 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.602332 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.602629 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.602925 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.603238 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.603537 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.603856 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.604153 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.604449 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.605432 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.605726 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.606083 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.606382 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.606692 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.607000 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.607310 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.607635 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.607943 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.608239 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.608546 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.608848 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.609152 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.609451 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.609746 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.610063 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.610363 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.610665 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.610979 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.611294 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.611633 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.611932 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.612234 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.612537 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.612838 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.613144 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.613449 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.613752 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.614054 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.614357 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.614659 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.614960 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.615258 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.615579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.615880 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.616179 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.616495 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.616797 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.617092 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.617391 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.617686 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.617986 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.618282 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.618708 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.619010 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.619311 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.619642 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.619947 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.620248 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.620687 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.620993 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.621291 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.621699 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.622022 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.622408 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.622599 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.622897 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.623194 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.623495 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.623836 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.624136 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.624433 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.624731 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.625045 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.625342 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.625653 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.626065 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.626369 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.626669 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.627074 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.627379 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.627702 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.628019 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.628334 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.628650 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.628948 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.629253 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.629556 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.629871 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.630185 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.630489 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.630796 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.631091 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.631405 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.631746 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.632053 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.632366 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.632773 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.633089 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.633391 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.633706 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.634019 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.634317 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.634612 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.634913 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.635209 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.635505 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.635848 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.636272 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.636579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.636884 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.637193 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.637490 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.637789 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.638105 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.638406 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.638722 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.639029 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.639345 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.639685 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.639985 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.640299 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.640601 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.640897 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.641192 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.641488 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.641823 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.642121 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.642435 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.642759 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.643079 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.643384 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.643737 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.644061 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.644372 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.644676 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.644985 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.645300 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.645598 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.645900 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.646203 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.646498 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.646907 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.647092 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.647394 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.647716 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.648016 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.648315 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.648632 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.648933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.649249 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.649550 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.649848 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.650147 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.650446 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.650779 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.651077 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.651396 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.652255 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.652574 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.652884 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.653190 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.653498 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.653804 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.654110 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.654416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.654723 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.655109 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.655508 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.655842 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.656160 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.656706 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.657029 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.657336 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.657643 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.657947 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.658255 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.658562 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.658864 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.659168 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.659470 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.659796 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.660119 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.660434 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.660752 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.661079 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.661392 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.661699 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.662003 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.662308 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.662653 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.662958 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.663256 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.663611 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.663889 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.664195 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.664497 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.664798 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.665102 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.665407 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.665709 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.666015 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.666318 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.666623 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.666937 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.667399 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.667788 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.668101 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.668410 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.668720 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.669234 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.669541 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.669866 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.670185 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.670501 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.670811 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.671122 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.671440 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.671769 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.672069 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.672374 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.672677 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.672978 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.673293 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.673597 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.673893 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.674205 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.674507 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.675028 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.675368 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.675702 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.676029 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.676347 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.676657 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.676957 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.677274 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.677575 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.677871 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.678179 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.678482 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.678780 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.679078 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.679410 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.679707 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.680006 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.680307 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.680603 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.680920 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.681218 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.681513 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.681810 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.682111 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.682406 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.682701 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.683565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.683881 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.684186 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.684484 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.684785 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.685082 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.685385 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.685726 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.686031 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.686328 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.686644 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.686940 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.687235 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.687543 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.687864 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.688181 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.688482 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.688784 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.689119 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.689426 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.689965 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.690295 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.690611 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.690940 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.691269 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.691584 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.691892 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.692192 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.692509 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.692814 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.693118 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.693420 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.693721 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.694023 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.694325 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.694625 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.694925 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.695225 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.695523 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.695849 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.696150 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.696450 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.696750 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.697053 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.697384 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.697693 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.698001 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.698309 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.699184 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.699485 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.699813 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.700118 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.700422 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.700730 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.701053 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.701361 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.701656 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.702348 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.702656 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.702970 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.703287 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.703608 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.703927 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.704244 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.704548 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.704863 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.705166 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.705487 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.705822 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.706141 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.706457 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.706755 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.707051 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.707347 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.707671 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.707985 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.708285 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.708584 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.709134 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.709434 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.709731 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.710026 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.710321 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.710616 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.710914 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.711225 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.711504 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.711820 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.712117 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.712414 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.712710 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.713010 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.713304 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.713601 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.713895 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.714341 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.714661 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.714986 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.715314 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.715652 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.715970 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.716274 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.716636 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.716891 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.717203 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.717516 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.717826 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.718129 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.718453 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.718756 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.719059 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.719365 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.719695 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.719998 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.720301 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.720621 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.720939 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.721238 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.721557 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.721864 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.722175 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.722480 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.722783 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.723102 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.723404 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.723735 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.724039 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.724341 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.724643 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.724950 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.725251 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.725559 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.725865 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.726171 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.726488 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.726805 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.727106 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.727422 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.727766 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.728104 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.728410 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.728744 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.729061 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.729368 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.729694 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.729991 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:53.730227 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 14:47:53.881557 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO dbcounter [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Registered counter for database nova_api Oct 31 14:47:53.904278 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_db.sqlalchemy.engines [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:47:53.910907 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writer thread running {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:47:53.968206 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.context [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d73f737-e281-44b5-9222-e10716a9638b(cell1) {{(pid=118907) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 14:47:53.972007 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:53.972473 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:53.974059 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:53.974755 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:53.975191 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:53.977207 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:53.979175 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO dbcounter [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Registered counter for database nova_cell0 Oct 31 14:47:53.983595 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO dbcounter [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Registered counter for database nova_cell1 Oct 31 14:47:53.991458 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_db.sqlalchemy.engines [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:47:53.993203 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_db.sqlalchemy.engines [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:47:53.999093 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writer thread running {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:47:54.000871 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writer thread running {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:47:54.003593 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 14:47:54.004030 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 14:47:54.004525 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 14:47:54.004966 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 14:47:54.005266 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 14:47:54.005718 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.006091 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.006459 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.006846 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.007255 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.007677 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.008076 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.008459 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.008834 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.009129 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.009522 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.009923 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860227-3-iscsi {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.010321 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.010683 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.011968 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.012365 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.012704 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.013099 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.013485 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.014077 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.014453 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.014837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.015225 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.015658 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.016036 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.016389 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.016758 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.017136 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.017539 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.017926 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.018405 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860227-3-iscsi {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.018793 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.019160 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.019514 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.020038 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.020389 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.020757 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.021159 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.021568 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.021953 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.022343 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.022710 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.023073 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.023457 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.023863 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.024247 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.024632 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.024998 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.025345 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.025711 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.026037 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.026423 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.027396 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.027824 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.028217 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.028486 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.028808 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.029201 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.029593 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.029945 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.030293 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.030662 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.031048 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.031436 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.031836 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.032185 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.032535 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.032920 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.033312 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.033709 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.034087 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.034454 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.034935 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.035208 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.035609 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.036031 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.036427 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.036809 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.037178 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.037549 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.037907 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.038296 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.038679 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.039074 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.039469 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.039848 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.040136 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.040519 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.040904 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.041294 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.041646 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.041992 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.042393 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.042772 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.043155 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.043531 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.043907 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.044254 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.044620 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.045009 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.045392 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.045767 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.046119 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.046469 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.046861 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.047266 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.047670 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.048051 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.048416 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.048763 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.049143 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.049528 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.049909 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.050305 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.050660 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.051011 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.051386 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.051786 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.052167 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.052569 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.052923 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.053274 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.053649 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.054037 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.054419 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.054802 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.055155 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.055498 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.055898 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.056283 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.056665 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.057040 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.057406 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.057804 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.058174 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.058550 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.058929 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.059327 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:47:54.059756 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.060143 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.060539 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.060896 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.061291 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.061702 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.062098 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.062487 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.062871 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.063246 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.063652 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.064014 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.064402 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.064798 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.065210 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.065602 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.065964 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.066323 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.066697 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.067085 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.067476 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.067909 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.068308 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.068670 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.069070 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.069465 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.069840 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.070245 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.070640 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.071028 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.071397 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.071782 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.072175 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.072546 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.072939 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.073336 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.074237 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.074642 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.075029 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.075410 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.075802 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.076160 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.076520 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.076928 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.077324 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.077722 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.078110 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.078470 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.078847 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.079211 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.079623 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.080015 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.080398 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.080766 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.081113 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.081471 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.081855 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.082254 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.082656 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.083034 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.083422 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.084171 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.084561 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.084938 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.085295 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.085652 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.086038 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.086434 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.086818 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.087215 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.087596 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.087949 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.088335 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.088722 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.089642 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.090024 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.090409 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.090800 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.091190 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.091584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.091963 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.092316 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.092687 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.093095 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.093505 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.093890 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.094283 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.094655 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.095020 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.095387 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.095792 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.096174 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.096555 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.096904 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.097258 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.097622 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.098005 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.098386 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.098764 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.099110 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.099479 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.099885 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.100271 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.100651 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.101026 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.101415 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.101755 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.102158 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.102562 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.102958 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.103351 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.103755 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.104130 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.104474 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.104904 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.105278 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.105667 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.106063 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.106443 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.106808 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.107161 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.107563 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.107952 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.108355 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.108746 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.109133 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.109525 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.109917 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.110279 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.110672 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.111066 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.111457 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.111871 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.112241 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.112595 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.112953 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.113345 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.113732 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.114121 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.114479 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.114849 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.115205 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.115615 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.116003 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.116392 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.116791 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.117169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.117518 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.117888 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.118287 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.118677 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.119070 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.119428 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.119815 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.120163 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.121118 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.121511 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.121896 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.122280 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.122628 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.122984 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.123422 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.123969 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.124347 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.124721 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.125121 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.125506 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.125909 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.126291 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.126639 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.126991 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.127385 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.127798 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.128179 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.128560 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.128908 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.129298 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.129667 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.130055 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.130444 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.130840 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.131195 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.131570 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.131938 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.132320 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.132713 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.133108 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.133473 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.133826 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.134185 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.134572 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.134956 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.135354 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.135752 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.136266 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.136603 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.136952 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.137318 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.137713 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.138392 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.138779 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.139141 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.139530 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.139970 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.140362 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.140774 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.141169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.141522 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.141869 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.142243 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.142624 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.143047 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.143434 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.143831 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.144183 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.144535 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.144920 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.145190 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO dbcounter [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Registered counter for database nova_cell0 Oct 31 14:47:54.145304 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.145683 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.146031 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.146379 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.146877 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.147138 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.147635 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.148024 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.148428 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.148804 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.149154 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.149502 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.149880 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.150304 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.150681 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.151102 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.152058 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.152454 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.152824 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.153130 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_db.sqlalchemy.engines [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:47:54.153223 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.153595 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.153974 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.154323 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.154667 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.155048 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.155434 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.155833 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.156221 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.156578 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.156930 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.157303 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.157689 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.157907 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writer thread running {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:47:54.158078 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.158449 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.158811 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.159162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.159536 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.159940 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.160327 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.160695 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.161048 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.161405 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.161787 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.162184 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.162568 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.162927 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.163273 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.163662 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.164050 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.164435 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.164836 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.165219 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.165571 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.165913 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.166297 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.166676 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.167056 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.168045 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.168416 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.168779 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.169135 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.169537 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.169884 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.170235 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.170584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.170941 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.171292 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.171670 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.172024 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.172381 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.172737 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.173114 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.173470 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.173825 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.174174 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.174521 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.174909 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.175260 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.175716 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.176070 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.176434 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.176800 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.177162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.177518 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.177887 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.178252 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.178607 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.178967 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.179331 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.179704 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.180058 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.180496 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.180877 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.181273 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.181620 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.182054 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.182432 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.182845 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.183277 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.183701 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.184062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.184423 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.184789 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.185310 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.185673 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.186034 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.186398 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.186767 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.187120 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.187479 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.187868 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.188225 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.188591 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.188954 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.189309 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.189664 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.190021 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.190385 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.190735 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.191215 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.191612 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.191983 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.192339 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.192693 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.193056 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.193422 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.193788 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.194145 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.194645 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.195004 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.195365 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.195744 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.196106 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.196461 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.196835 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.197210 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.197620 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.198029 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.198409 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.198864 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.199145 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.199546 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.200096 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.200456 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.200807 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.201265 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.201628 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.201985 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.202363 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.202737 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.203111 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.203466 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.203850 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.204212 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.204586 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.204971 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.205335 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.205697 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.206046 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.206422 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.206787 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.207152 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.207530 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.208039 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.208403 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.209064 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.209427 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.209813 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.210165 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.210520 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.210874 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.211222 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.211597 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.211963 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.212315 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.212677 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.213038 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.213397 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.213750 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.214656 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.215032 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.215377 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.215792 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.216186 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.216580 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.216982 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.217349 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.217722 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.218074 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.218501 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.218838 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.219227 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.219660 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.220018 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.220391 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.220773 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.221174 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.221571 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.221980 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.222387 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.222783 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.223139 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.223501 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.223911 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.224295 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.224677 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.225064 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.225421 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.225764 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.226124 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.226514 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.226894 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.227261 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.227629 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.227997 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.228367 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.228771 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.229159 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.229533 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.230484 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.230834 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.231235 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.231606 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.232008 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.232397 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.232792 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.233180 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.233551 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.233913 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.234284 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.234673 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.235066 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.235458 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.235872 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.236245 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.236609 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.236982 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.237657 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.238032 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.238395 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.238768 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.239156 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.239564 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.239963 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.240335 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.240693 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.241048 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.241435 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.241841 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.242237 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.242641 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.243039 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.243410 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.243805 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.244180 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.244571 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.245009 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.245454 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.245807 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.246170 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.246533 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.246903 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.247263 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.247655 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.248017 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.248383 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.248736 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.249096 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.249456 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.249823 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.250206 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.250590 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.250958 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.251322 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.251709 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.252086 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.252676 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.253042 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.253434 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.253814 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.254182 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.254549 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.254910 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.255280 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.255674 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.256032 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.256393 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.256750 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.257098 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.257466 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.257826 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.258180 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.258549 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.259027 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.259537 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.259983 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.260318 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.260686 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.261081 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.261445 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.261800 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.262203 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.262542 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.262893 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.263258 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.263638 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.263997 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.264348 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.264704 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.265066 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.265416 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.265779 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.266129 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.266501 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.266850 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.267206 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.267569 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.267938 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.268298 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.268650 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.269008 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.269357 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.269716 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.270062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.270418 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.270768 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.271128 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.271517 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.271894 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.272252 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.272628 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.272979 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.273330 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.273692 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.274046 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.274413 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.274770 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.275132 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.275545 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.275933 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.277097 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.277484 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.277854 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.278241 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.278624 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.278984 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.279339 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.279723 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.280098 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.280461 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.280821 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.281180 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.281539 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.281898 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.282272 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.282635 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.282991 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.283346 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.283724 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.284081 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.284444 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.284802 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.285162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.285536 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.285929 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.286296 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.286666 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.287029 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.287392 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.287801 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.288165 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.288521 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.288873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.289240 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.289612 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.289977 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.290324 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.291145 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.291515 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.291904 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.292915 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.293273 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.293648 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.294043 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.294436 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.294830 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.295223 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.295769 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.296184 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.296597 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.296986 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.297338 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.297686 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.298069 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.298460 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.298859 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.299233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.299597 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.299947 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.300324 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.300705 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.301088 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.301445 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.301787 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.302153 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.302535 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.302915 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.303284 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.303653 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.304000 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.304372 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.304753 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.305134 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.305487 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.305825 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.306187 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.306571 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.306976 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.307384 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.307908 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.308351 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.309051 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.309444 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.309805 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.310181 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.310553 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.310925 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.311285 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.311718 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.312080 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.312442 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.312805 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.313169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.313527 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.313888 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.314285 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.314666 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.315019 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.315393 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.315781 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.316153 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.316530 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.316897 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.317285 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.317643 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.318007 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.318364 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.318730 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.319090 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.319462 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.319873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.320236 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.320599 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.320960 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.321335 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.321708 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.322080 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.322458 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.322833 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.323224 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.323891 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.324284 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.324672 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.325044 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.325402 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.325752 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:47:54.326039 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 14:47:54.496650 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO dbcounter [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Registered counter for database nova_api Oct 31 14:47:54.501864 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: WARNING keystonemiddleware.auth_token [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:47:54.509163 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: WARNING keystonemiddleware.auth_token [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:47:54.519861 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_db.sqlalchemy.engines [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:47:54.526945 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writer thread running {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:47:54.584482 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.context [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d73f737-e281-44b5-9222-e10716a9638b(cell1) {{(pid=118908) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 14:47:54.588393 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_concurrency.lockutils [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:54.588856 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_concurrency.lockutils [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:54.590650 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_concurrency.lockutils [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:54.591478 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_concurrency.lockutils [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:47:54.591946 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_concurrency.lockutils [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:47:54.593946 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_concurrency.lockutils [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:47:54.595955 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO dbcounter [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Registered counter for database nova_cell0 Oct 31 14:47:54.600033 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO dbcounter [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Registered counter for database nova_cell1 Oct 31 14:47:54.608208 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_db.sqlalchemy.engines [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:47:54.612209 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_db.sqlalchemy.engines [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:47:54.614878 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writer thread running {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:47:54.771913 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writer thread running {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:47:54.784272 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO dbcounter [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Registered counter for database nova_cell0 Oct 31 14:47:54.791891 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG oslo_db.sqlalchemy.engines [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:47:54.797384 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writer thread running {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:47:54.854125 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: WARNING keystonemiddleware.auth_token [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:47:54.864971 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: WARNING keystonemiddleware.auth_token [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:47:54.873904 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558cce0139c0 pid: 118907 (default app) Oct 31 14:47:54.876054 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:47:54.877292 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001810 Oct 31 14:47:54.877708 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Mon Oct 31 14:47:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:47:55.155414 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: WARNING keystonemiddleware.auth_token [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:47:55.163675 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: WARNING keystonemiddleware.auth_token [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:47:55.537023 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: WARNING keystonemiddleware.auth_token [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:47:55.544159 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: WARNING keystonemiddleware.auth_token [None req-397adc98-61de-4fd0-a88d-f5078076d909 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:47:55.550154 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558cce0139c0 pid: 118908 (default app) Oct 31 14:49:22.027223 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:22.028442 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Oct 31 14:49:22.028839 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:22.040823 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writing DB stats nova_api:SELECT=3 {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:22.041780 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writing DB stats nova_cell1:SELECT=3 {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:22.042782 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writing DB stats nova_cell0:SELECT=3 {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:22.043593 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writing DB stats nova_cell0:SELECT=3 {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:22.930090 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-b2768d74-fbf0-4154-8d76-0f7fabfe2e80 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:22.963123 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-b2768d74-fbf0-4154-8d76-0f7fabfe2e80 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927320 Oct 31 14:49:22.963995 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1292 bytes} [Mon Oct 31 14:49:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:49:25.603655 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:25.604662 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-2a051600-281d-4bf5-9faf-acd7456eb30d None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 31 14:49:25.605067 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:26.051781 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-154b2423-7d52-45e8-a8b6-bc067dbc14ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "vcpus": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:26.100716 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-154b2423-7d52-45e8-a8b6-bc067dbc14ac admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488915 Oct 31 14:49:26.101543 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:26.115447 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_api:SELECT=3 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:26.116384 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_cell1:SELECT=3 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:26.121004 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_cell0:SELECT=3 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:26.122186 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:26.332280 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-5c19aaff-0b0b-4a44-a1fe-97da89d77d38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:26.401165 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-5c19aaff-0b0b-4a44-a1fe-97da89d77d38 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291050 Oct 31 14:49:26.401763 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 31 14:49:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:29.083592 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-154b2423-7d52-45e8-a8b6-bc067dbc14ac admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:29.084547 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-154b2423-7d52-45e8-a8b6-bc067dbc14ac admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Oct 31 14:49:29.085151 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:29.751175 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-9c2571a9-27f8-42d9-ab42-c5a9071d9dda admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "ram": 512}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:29.795705 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-9c2571a9-27f8-42d9-ab42-c5a9071d9dda admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.703813 Oct 31 14:49:29.796886 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:29.809077 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-6517f011-6d43-4581-a0c5-f60bd3180b32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:29.849607 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-6517f011-6d43-4581-a0c5-f60bd3180b32 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044255 Oct 31 14:49:29.850963 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 31 14:49:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:32.476625 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-9c2571a9-27f8-42d9-ab42-c5a9071d9dda admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:32.477675 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-9c2571a9-27f8-42d9-ab42-c5a9071d9dda admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 31 14:49:32.478073 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:32.911197 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-f0c28081-a8a8-4831-b30a-144f01f3fb00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:32.930899 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-f0c28081-a8a8-4831-b30a-144f01f3fb00 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446279 Oct 31 14:49:32.931463 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:49:32.944788 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-eea0dd71-dedc-4295-b636-382b3f0b39d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:32.975382 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-eea0dd71-dedc-4295-b636-382b3f0b39d8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033991 Oct 31 14:49:32.977724 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 31 14:49:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:35.632397 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-f0c28081-a8a8-4831-b30a-144f01f3fb00 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:35.633400 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-f0c28081-a8a8-4831-b30a-144f01f3fb00 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 31 14:49:35.633800 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:36.052918 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-b14a5cfb-0e6f-49f1-857a-bff74b3d33b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:36.074016 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-b14a5cfb-0e6f-49f1-857a-bff74b3d33b3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434114 Oct 31 14:49:36.075266 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:36.088251 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-727bace2-62de-4920-800c-f9f1640165db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:36.120031 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-727bace2-62de-4920-800c-f9f1640165db admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036248 Oct 31 14:49:36.120738 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 31 14:49:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:49:38.786320 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-b14a5cfb-0e6f-49f1-857a-bff74b3d33b3 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:38.787271 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-b14a5cfb-0e6f-49f1-857a-bff74b3d33b3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 31 14:49:38.787722 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:39.255866 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-caa16afa-9e4d-4d24-a2c5-0134c9768956 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G"}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:39.274933 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-caa16afa-9e4d-4d24-a2c5-0134c9768956 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480793 Oct 31 14:49:39.275501 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:49:39.287805 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-c6630677-fc38-4757-a715-a4934e8aff13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:39.312503 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-c6630677-fc38-4757-a715-a4934e8aff13 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028330 Oct 31 14:49:39.313075 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 31 14:49:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:42.505555 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-caa16afa-9e4d-4d24-a2c5-0134c9768956 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:42.506636 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-caa16afa-9e4d-4d24-a2c5-0134c9768956 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Oct 31 14:49:42.507062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:43.007965 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-b833e9aa-9ebb-4370-bdf0-f55101a3166e admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:43.055524 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-b833e9aa-9ebb-4370-bdf0-f55101a3166e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.537562 Oct 31 14:49:43.056700 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1292 bytes} [Mon Oct 31 14:49:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:49:46.031751 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-caa16afa-9e4d-4d24-a2c5-0134c9768956 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:46.032759 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-caa16afa-9e4d-4d24-a2c5-0134c9768956 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 31 14:49:46.033174 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:46.442583 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-e9c98fa9-f9dd-414e-a108-6ad603828fd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:46.463904 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-e9c98fa9-f9dd-414e-a108-6ad603828fd7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.424518 Oct 31 14:49:46.464438 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:46.476301 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-9d0dfcca-7b8c-4dc6-a600-a12377a6f57f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:46.504471 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-9d0dfcca-7b8c-4dc6-a600-a12377a6f57f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031758 Oct 31 14:49:46.505054 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 31 14:49:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:49.146237 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-e9c98fa9-f9dd-414e-a108-6ad603828fd7 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:49.148258 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-e9c98fa9-f9dd-414e-a108-6ad603828fd7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002462 Oct 31 14:49:49.149257 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:49.571100 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-4525513f-574f-4c07-afa2-75fd542340d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:49.591345 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-4525513f-574f-4c07-afa2-75fd542340d1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.435618 Oct 31 14:49:49.599480 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:49.604665 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-4e0e4fe7-a751-43a1-b1b0-c316cd39b196 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:49.632925 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-4e0e4fe7-a751-43a1-b1b0-c316cd39b196 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032376 Oct 31 14:49:49.633542 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 31 14:49:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:49:52.274891 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-4525513f-574f-4c07-afa2-75fd542340d1 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:52.276797 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-4525513f-574f-4c07-afa2-75fd542340d1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002356 Oct 31 14:49:52.294990 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:52.750688 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-48267623-c25d-436d-9119-0ea10d50a44a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "vcpus": 2}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:52.772581 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-48267623-c25d-436d-9119-0ea10d50a44a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.487831 Oct 31 14:49:52.775583 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:52.785259 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-7e040eaf-dea7-4290-a2d2-19ff2ab4de3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:52.797297 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:52.817101 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-7e040eaf-dea7-4290-a2d2-19ff2ab4de3d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035353 Oct 31 14:49:52.817698 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 31 14:49:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:49:55.447636 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-48267623-c25d-436d-9119-0ea10d50a44a admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:55.448643 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-48267623-c25d-436d-9119-0ea10d50a44a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 31 14:49:55.449237 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:55.886236 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-6d5ddf5d-2c66-4593-a72f-962e04d5fc88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:55.906640 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-6d5ddf5d-2c66-4593-a72f-962e04d5fc88 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450066 Oct 31 14:49:55.914493 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:49:55.919353 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-86a9bc60-df46-4020-be47-6f76ee63f176 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:55.945294 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-86a9bc60-df46-4020-be47-6f76ee63f176 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029792 Oct 31 14:49:55.945989 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 31 14:49:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:49:58.578999 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-6d5ddf5d-2c66-4593-a72f-962e04d5fc88 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:49:58.580215 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-6d5ddf5d-2c66-4593-a72f-962e04d5fc88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Oct 31 14:49:58.580623 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:49:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:49:59.005197 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-1850291f-2aa2-4335-ace7-1500ce635966 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "id": "5", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:59.014017 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:59.026762 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-1850291f-2aa2-4335-ace7-1500ce635966 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.440095 Oct 31 14:49:59.027403 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 31 14:49:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:59.039512 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-e10da7e2-d983-4882-95cd-7bb13e879e4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:49:59.067747 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-e10da7e2-d983-4882-95cd-7bb13e879e4a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031865 Oct 31 14:49:59.068771 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 31 14:49:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:50:15.835495 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-1850291f-2aa2-4335-ace7-1500ce635966 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:15.836460 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-1850291f-2aa2-4335-ace7-1500ce635966 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 31 14:50:15.836866 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:50:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:15.847707 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:16.251933 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-5f4ecac7-a992-427a-af04-9801df170054 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:16.272588 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-5f4ecac7-a992-427a-af04-9801df170054 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.429307 Oct 31 14:50:16.273122 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1292 bytes} [Mon Oct 31 14:50:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:50:17.583598 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-1850291f-2aa2-4335-ace7-1500ce635966 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:17.584612 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-1850291f-2aa2-4335-ace7-1500ce635966 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 31 14:50:17.584999 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:50:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:18.114199 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-9316036a-e121-4ffe-8a7c-9fb50dea7f8c admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:18.119544 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.wsgi [None req-9316036a-e121-4ffe-8a7c-9fb50dea7f8c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-9316036a-e121-4ffe-8a7c-9fb50dea7f8c admin admin] Request method failure captured: Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Accept: application/json Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Accept-Encoding: gzip, deflate Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Connection: keep-alive Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Content-Length: 0 Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Host: 10.222.0.36 Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Openstack-Api-Version: compute 2.92 Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Openstack-System-Scope: None Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: User-Agent: python-novaclient Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Auth-Token: gAAAAABjX-CpyrifIZdd94RxrtyUQLxA_kIWCYMpSzNJBcsmWZlOFpDgd8FVQaJhEgSObsYbTxtw4DEKUZUnYqaFKrqbZnnJGendOiPTWpMWQsqSRPhYfPvG698i48iTUpB4RXrjQG213PacHbS0utqPoCEt6X-raZs8gCOHERj67iJjH6A_Ebg Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Domain-Id: None Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Domain-Name: None Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Identity-Status: Confirmed Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Is-Admin-Project: True Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Domain-Id: default Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Domain-Name: Default Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Name: admin Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Role: reader,admin,member Oct 31 14:50:18.123342 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Roles: reader,admin,member Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e18b2b57837347e48db3adc0214764b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e18b2b57837347e48db3adc0214764b8"}]}] Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Tenant: admin Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Tenant-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Tenant-Name: admin Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User: admin Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Domain-Id: default Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Domain-Name: Default Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Id: 7c12195059ec40bfafbb7be8e9f46734 Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Name: admin Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: method: > Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: exception: Flavor 42 could not be found. Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: action_args: {'id': '42'} Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:50:18.125025 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:18.126062 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.127233 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-9316036a-e121-4ffe-8a7c-9fb50dea7f8c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=118908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:50:18.128282 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-9316036a-e121-4ffe-8a7c-9fb50dea7f8c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392682 Oct 31 14:50:18.128282 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Mon Oct 31 14:50:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:18.134710 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-7be73943-f1b4-4236-8a35-16e86e226e06 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:18.158567 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-7be73943-f1b4-4236-8a35-16e86e226e06 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027369 Oct 31 14:50:18.159114 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 31 14:50:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:50:18.170527 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-27ac64f0-ff2b-4eb1-8020-4ca50ec5121c admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:18.192668 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-27ac64f0-ff2b-4eb1-8020-4ca50ec5121c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027442 Oct 31 14:50:18.193187 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 31 14:50:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:50:18.202783 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-76d255f3-6b32-426b-b781-f2f1e5a4fb8f admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:18.208491 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.wsgi [None req-76d255f3-6b32-426b-b781-f2f1e5a4fb8f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-76d255f3-6b32-426b-b781-f2f1e5a4fb8f admin admin] Request method failure captured: Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Accept: application/json Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Accept-Encoding: gzip, deflate Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Connection: keep-alive Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Content-Length: 0 Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Host: 10.222.0.36 Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Openstack-Api-Version: compute 2.92 Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Openstack-System-Scope: None Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: User-Agent: python-novaclient Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Auth-Token: gAAAAABjX-CpyrifIZdd94RxrtyUQLxA_kIWCYMpSzNJBcsmWZlOFpDgd8FVQaJhEgSObsYbTxtw4DEKUZUnYqaFKrqbZnnJGendOiPTWpMWQsqSRPhYfPvG698i48iTUpB4RXrjQG213PacHbS0utqPoCEt6X-raZs8gCOHERj67iJjH6A_Ebg Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Domain-Id: None Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Domain-Name: None Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Identity-Status: Confirmed Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Is-Admin-Project: True Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Domain-Id: default Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Domain-Name: Default Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Name: admin Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Role: reader,admin,member Oct 31 14:50:18.211816 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Roles: reader,admin,member Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e18b2b57837347e48db3adc0214764b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e18b2b57837347e48db3adc0214764b8"}]}] Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Tenant: admin Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Tenant-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Tenant-Name: admin Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User: admin Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Domain-Id: default Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Domain-Name: Default Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Id: 7c12195059ec40bfafbb7be8e9f46734 Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Name: admin Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: method: > Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: exception: Flavor 42 could not be found. Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: action_args: {'id': '42'} Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:50:18.213416 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:18.214565 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:18.216167 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-76d255f3-6b32-426b-b781-f2f1e5a4fb8f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=118907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:50:18.217198 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-76d255f3-6b32-426b-b781-f2f1e5a4fb8f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014321 Oct 31 14:50:18.217198 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Mon Oct 31 14:50:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:19.413855 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-27ac64f0-ff2b-4eb1-8020-4ca50ec5121c admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:19.414889 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-27ac64f0-ff2b-4eb1-8020-4ca50ec5121c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 31 14:50:19.415287 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:50:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:19.938832 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-5df6aa01-f26c-46f6-a111-6f3cb4490420 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:19.943869 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.wsgi [None req-5df6aa01-f26c-46f6-a111-6f3cb4490420 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-5df6aa01-f26c-46f6-a111-6f3cb4490420 admin admin] Request method failure captured: Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Accept: application/json Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Accept-Encoding: gzip, deflate Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Connection: keep-alive Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Content-Length: 0 Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Host: 10.222.0.36 Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Openstack-Api-Version: compute 2.92 Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Openstack-System-Scope: None Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: User-Agent: python-novaclient Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Auth-Token: gAAAAABjX-Cr1mqtsRjhCyMVcjuZtj0_hoZ_39NxU04rircjz9Pdk8cbchl1SpMlQCQKGrUvy_0Lv-k2fT9OJtQ1N1N1FKZA3aGKtdxB6dit4vv-wJkE3kwcry5x28fy0WSUaKM1ttUSP2C4aJiduTB9WivkkBv8GssBDLsK8MeO77wIi8hTe4E Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Domain-Id: None Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Domain-Name: None Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Identity-Status: Confirmed Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Is-Admin-Project: True Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Domain-Id: default Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Domain-Name: Default Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Name: admin Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Role: reader,admin,member Oct 31 14:50:19.945375 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Roles: reader,admin,member Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e18b2b57837347e48db3adc0214764b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e18b2b57837347e48db3adc0214764b8"}]}] Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Tenant: admin Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Tenant-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Tenant-Name: admin Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User: admin Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Domain-Id: default Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Domain-Name: Default Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Id: 7c12195059ec40bfafbb7be8e9f46734 Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Name: admin Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: method: > Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: exception: Flavor 84 could not be found. Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: action_args: {'id': '84'} Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:50:19.946703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:19.947579 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:19.949056 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-5df6aa01-f26c-46f6-a111-6f3cb4490420 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=118907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:50:19.950478 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-5df6aa01-f26c-46f6-a111-6f3cb4490420 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394191 Oct 31 14:50:19.950478 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Mon Oct 31 14:50:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:19.957204 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-0b8c5900-5903-4dd2-8924-78371ce34e6b admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:19.972742 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-0b8c5900-5903-4dd2-8924-78371ce34e6b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019072 Oct 31 14:50:19.973271 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 31 14:50:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:50:19.983199 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-0907d93c-3db0-4852-b263-a8b5ff617d94 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:19.998681 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-0907d93c-3db0-4852-b263-a8b5ff617d94 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019613 Oct 31 14:50:19.999203 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 31 14:50:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:50:20.008311 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-4c5c9e20-6717-43cb-a46a-cbfee9329e85 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:20.014007 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.wsgi [None req-4c5c9e20-6717-43cb-a46a-cbfee9329e85 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-4c5c9e20-6717-43cb-a46a-cbfee9329e85 admin admin] Request method failure captured: Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Accept: application/json Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Accept-Encoding: gzip, deflate Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Connection: keep-alive Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Content-Length: 0 Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Host: 10.222.0.36 Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Openstack-Api-Version: compute 2.92 Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Openstack-System-Scope: None Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: User-Agent: python-novaclient Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Auth-Token: gAAAAABjX-Cr1mqtsRjhCyMVcjuZtj0_hoZ_39NxU04rircjz9Pdk8cbchl1SpMlQCQKGrUvy_0Lv-k2fT9OJtQ1N1N1FKZA3aGKtdxB6dit4vv-wJkE3kwcry5x28fy0WSUaKM1ttUSP2C4aJiduTB9WivkkBv8GssBDLsK8MeO77wIi8hTe4E Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Domain-Id: None Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Domain-Name: None Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Identity-Status: Confirmed Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Is-Admin-Project: True Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Domain-Id: default Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Domain-Name: Default Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Name: admin Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Role: reader,admin,member Oct 31 14:50:20.016162 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Roles: reader,admin,member Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e18b2b57837347e48db3adc0214764b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e18b2b57837347e48db3adc0214764b8"}]}] Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Tenant: admin Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Tenant-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Tenant-Name: admin Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User: admin Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Domain-Id: default Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Domain-Name: Default Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Id: 7c12195059ec40bfafbb7be8e9f46734 Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Name: admin Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: method: > Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: exception: Flavor 84 could not be found. Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: action_args: {'id': '84'} Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:50:20.017837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:20.018726 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:20.019873 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-4c5c9e20-6717-43cb-a46a-cbfee9329e85 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=118908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:50:20.021570 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-4c5c9e20-6717-43cb-a46a-cbfee9329e85 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012064 Oct 31 14:50:20.021570 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Mon Oct 31 14:50:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 31 14:50:21.232726 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-0907d93c-3db0-4852-b263-a8b5ff617d94 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:21.233725 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-0907d93c-3db0-4852-b263-a8b5ff617d94 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 31 14:50:21.234125 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:50:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:50:21.757056 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-5928040f-a925-4d95-8070-efdb16fd2c7f admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:21.763358 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.wsgi [None req-5928040f-a925-4d95-8070-efdb16fd2c7f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-5928040f-a925-4d95-8070-efdb16fd2c7f admin admin] Request method failure captured: Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Accept: application/json Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Accept-Encoding: gzip, deflate Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Connection: keep-alive Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Content-Length: 0 Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Host: 10.222.0.36 Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Openstack-Api-Version: compute 2.92 Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Openstack-System-Scope: None Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: User-Agent: python-novaclient Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Auth-Token: gAAAAABjX-CtFITmzjqxYf6kl_ErxnXT1djH0H5rms-2TXWdWeC1qNRqUOD8RZ178LhjWG48XhJ59rXYMZBxPpPpseR4uklUiepR0xPe7QICsAaqr-kRRTNaflhEJmM9spLGmFwEbR3pHvr3227_2x_xY4gHjxp-hkCc-zrPTE3bSRwMNYjGZu4 Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Domain-Id: None Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Domain-Name: None Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Identity-Status: Confirmed Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Is-Admin-Project: True Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Domain-Id: default Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Domain-Name: Default Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Project-Name: admin Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Role: reader,admin,member Oct 31 14:50:21.764870 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Roles: reader,admin,member Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e18b2b57837347e48db3adc0214764b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e18b2b57837347e48db3adc0214764b8"}]}] Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Tenant: admin Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Tenant-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-Tenant-Name: admin Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User: admin Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Domain-Id: default Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Domain-Name: Default Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Id: 7c12195059ec40bfafbb7be8e9f46734 Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: X-User-Name: admin Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: method: > Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: exception: Flavor 451 could not be found. Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: action_args: {'id': '451'} Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:50:21.766232 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:21.767169 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.768584 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-5928040f-a925-4d95-8070-efdb16fd2c7f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=118908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:50:21.769810 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-5928040f-a925-4d95-8070-efdb16fd2c7f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394746 Oct 31 14:50:21.769810 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 31 14:50:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:21.775854 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-5b9efe33-4d8b-48bb-ba05-1173b2cbaec8 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:21.791474 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-5b9efe33-4d8b-48bb-ba05-1173b2cbaec8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019142 Oct 31 14:50:21.792080 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 31 14:50:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:50:21.801642 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:21.818163 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020012 Oct 31 14:50:21.818704 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 31 14:50:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:50:21.828960 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-c9c6312d-9938-49ff-8664-a0ea294f0391 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:21.833912 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.wsgi [None req-c9c6312d-9938-49ff-8664-a0ea294f0391 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-c9c6312d-9938-49ff-8664-a0ea294f0391 admin admin] Request method failure captured: Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Accept: application/json Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Accept-Encoding: gzip, deflate Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Connection: keep-alive Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Content-Length: 0 Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Host: 10.222.0.36 Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Openstack-Api-Version: compute 2.92 Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Openstack-System-Scope: None Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: User-Agent: python-novaclient Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Auth-Token: gAAAAABjX-CtFITmzjqxYf6kl_ErxnXT1djH0H5rms-2TXWdWeC1qNRqUOD8RZ178LhjWG48XhJ59rXYMZBxPpPpseR4uklUiepR0xPe7QICsAaqr-kRRTNaflhEJmM9spLGmFwEbR3pHvr3227_2x_xY4gHjxp-hkCc-zrPTE3bSRwMNYjGZu4 Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Domain-Id: None Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Domain-Name: None Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Identity-Status: Confirmed Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Is-Admin-Project: True Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Domain-Id: default Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Domain-Name: Default Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Project-Name: admin Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Role: reader,admin,member Oct 31 14:50:21.835415 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Roles: reader,admin,member Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e18b2b57837347e48db3adc0214764b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e18b2b57837347e48db3adc0214764b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e18b2b57837347e48db3adc0214764b8"}]}] Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Tenant: admin Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Tenant-Id: e18b2b57837347e48db3adc0214764b8 Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-Tenant-Name: admin Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User: admin Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Domain-Id: default Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Domain-Name: Default Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Id: 7c12195059ec40bfafbb7be8e9f46734 Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: X-User-Name: admin Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: method: > Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: exception: Flavor 451 could not be found. Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: action_args: {'id': '451'} Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:50:21.836996 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:21.837933 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: ERROR nova.api.openstack.wsgi Oct 31 14:50:21.839443 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-c9c6312d-9938-49ff-8664-a0ea294f0391 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=118907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:50:21.841225 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-c9c6312d-9938-49ff-8664-a0ea294f0391 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012389 Oct 31 14:50:21.841225 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 31 14:50:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 31 14:50:23.036946 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:23.037947 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 31 14:50:23.038343 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:50:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:23.562274 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-4ffc7680-3b24-4649-8cab-d620ba30a058 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:23.581848 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-4ffc7680-3b24-4649-8cab-d620ba30a058 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405275 Oct 31 14:50:23.582382 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Mon Oct 31 14:50:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:50:24.789676 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:24.790616 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Oct 31 14:50:24.791019 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:50:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:25.313411 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-d10e9859-218b-400e-ad28-0bfbc9ca249f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:25.333887 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-d10e9859-218b-400e-ad28-0bfbc9ca249f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.403855 Oct 31 14:50:25.334404 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Mon Oct 31 14:50:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 14:50:26.537387 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:26.538388 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 31 14:50:26.538785 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:50:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:27.071275 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-d434a4cc-a78d-4f59-b065-2056c927fb02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:27.091411 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-d434a4cc-a78d-4f59-b065-2056c927fb02 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.416768 Oct 31 14:50:27.091990 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Mon Oct 31 14:50:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:50:28.309439 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:28.310451 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 31 14:50:28.310837 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:50:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:28.855909 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-445ad8af-155f-44af-915f-3814f89f482f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:50:28.874824 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-445ad8af-155f-44af-915f-3814f89f482f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.424809 Oct 31 14:50:28.875381 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Mon Oct 31 14:50:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:50:30.078871 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:30.079898 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Oct 31 14:50:30.080300 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:50:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:50:30.610559 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-2242b8f6-2695-4bbd-855e-47f53fc49bc5 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:50:30.635143 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-2242b8f6-2695-4bbd-855e-47f53fc49bc5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.416561 Oct 31 14:50:30.635883 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Mon Oct 31 14:50:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:51:28.332916 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:28.333923 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-7c78c981-3d48-4a22-85a2-e2cedda354a0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 31 14:51:28.334325 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 31 14:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:51:28.344772 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:28.723438 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-8b302ccb-d4d9-4646-a4f2-6a53f27f6a37 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:28.744210 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-8b302ccb-d4d9-4646-a4f2-6a53f27f6a37 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403790 Oct 31 14:51:28.744749 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1292 bytes} [Mon Oct 31 14:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:51:28.766827 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writing DB stats nova_api:SELECT=14 {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:28.770707 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-bb24fbb6-0853-4e0c-9ef6-465be2f07bad admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:28.778095 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-bb24fbb6-0853-4e0c-9ef6-465be2f07bad admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012772 Oct 31 14:51:28.778612 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1283 bytes} [Mon Oct 31 14:51:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:28.790365 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-9feb72a2-a3c3-4b07-ab93-6eb94dcc0e9c admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:28.798118 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-9feb72a2-a3c3-4b07-ab93-6eb94dcc0e9c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011293 Oct 31 14:51:28.798634 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1286 bytes} [Mon Oct 31 14:51:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:28.810963 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:28.818196 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011880 Oct 31 14:51:28.818716 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1286 bytes} [Mon Oct 31 14:51:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:51:28.830466 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-aa2c7b05-9657-465f-948d-1030bb1ceaee admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:51:28.837710 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-aa2c7b05-9657-465f-948d-1030bb1ceaee admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010693 Oct 31 14:51:28.838213 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1283 bytes} [Mon Oct 31 14:51:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:54:31.664052 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:31.665109 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 31 14:54:31.665505 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:54:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:54:31.805049 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_api:SELECT=6 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:31.961870 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-2fbfd4db-b24e-42f8-be68-fcc004512f8b admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:31.966785 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2fbfd4db-b24e-42f8-be68-fcc004512f8b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:31.967285 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2fbfd4db-b24e-42f8-be68-fcc004512f8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:31.967739 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2fbfd4db-b24e-42f8-be68-fcc004512f8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:31.968437 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2fbfd4db-b24e-42f8-be68-fcc004512f8b admin admin] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:31.968871 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2fbfd4db-b24e-42f8-be68-fcc004512f8b admin admin] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:31.969277 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-2fbfd4db-b24e-42f8-be68-fcc004512f8b admin admin] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:32.000520 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-2fbfd4db-b24e-42f8-be68-fcc004512f8b admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.196741 Oct 31 14:54:32.001077 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 31 14:54:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:54:33.076768 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:33.077771 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 31 14:54:33.078171 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:54:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:54:33.271136 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-c0651788-15fb-4ae3-b5b9-d07b980e1156 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:33.274526 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-c0651788-15fb-4ae3-b5b9-d07b980e1156 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:33.275033 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-c0651788-15fb-4ae3-b5b9-d07b980e1156 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:33.275482 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-c0651788-15fb-4ae3-b5b9-d07b980e1156 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:33.276235 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-c0651788-15fb-4ae3-b5b9-d07b980e1156 admin admin] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:33.276678 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-c0651788-15fb-4ae3-b5b9-d07b980e1156 admin admin] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:33.277090 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-c0651788-15fb-4ae3-b5b9-d07b980e1156 admin admin] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:33.296557 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-c0651788-15fb-4ae3-b5b9-d07b980e1156 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078486 Oct 31 14:54:33.297102 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 31 14:54:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:54:44.802915 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:44.803999 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 31 14:54:44.804408 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:54:44.949747 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_cell0:SELECT=4 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:44.950958 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_cell1:SELECT=4 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:44.951581 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG dbcounter [-] [118907] Writing DB stats nova_api:SELECT=8 {{(pid=118907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:44.999164 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-8ae6a0d4-dcfa-410c-838d-bced308a60a1 admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:45.002703 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-8ae6a0d4-dcfa-410c-838d-bced308a60a1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:45.003177 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-8ae6a0d4-dcfa-410c-838d-bced308a60a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:45.003638 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-8ae6a0d4-dcfa-410c-838d-bced308a60a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:45.004349 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-8ae6a0d4-dcfa-410c-838d-bced308a60a1 admin admin] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:45.004793 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-8ae6a0d4-dcfa-410c-838d-bced308a60a1 admin admin] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:45.005211 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-8ae6a0d4-dcfa-410c-838d-bced308a60a1 admin admin] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:45.031781 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-8ae6a0d4-dcfa-410c-838d-bced308a60a1 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086369 Oct 31 14:54:45.032374 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 31 14:54:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:54:46.130525 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG nova.api.openstack.wsgi [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] Calling method '>' {{(pid=118908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:46.131528 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: INFO nova.api.openstack.requestlog [None req-d6575231-749a-4d10-94d8-99e173b6340e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Oct 31 14:54:46.131958 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: [pid: 118908|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 31 14:54:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:54:46.322619 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG nova.api.openstack.wsgi [None req-859f8053-d6d1-48d7-a37a-ca0fbd9dbdcd admin admin] Calling method '>' {{(pid=118907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:54:46.326272 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-859f8053-d6d1-48d7-a37a-ca0fbd9dbdcd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:46.326778 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-859f8053-d6d1-48d7-a37a-ca0fbd9dbdcd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:46.327206 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-859f8053-d6d1-48d7-a37a-ca0fbd9dbdcd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:46.327977 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-859f8053-d6d1-48d7-a37a-ca0fbd9dbdcd admin admin] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:54:46.328453 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-859f8053-d6d1-48d7-a37a-ca0fbd9dbdcd admin admin] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:54:46.328871 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: DEBUG oslo_concurrency.lockutils [None req-859f8053-d6d1-48d7-a37a-ca0fbd9dbdcd admin admin] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:54:46.352614 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: INFO nova.api.openstack.requestlog [None req-859f8053-d6d1-48d7-a37a-ca0fbd9dbdcd admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.082376 Oct 31 14:54:46.353118 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: [pid: 118907|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 31 14:54:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:55:44.418945 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: Mon Oct 31 14:55:44 2022 - graceful shutdown triggered... Oct 31 14:55:44.419083 dv-cinder-860227-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 31 14:55:44.420029 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: Gracefully killing worker 2 (pid: 118908)... Oct 31 14:55:44.420426 dv-cinder-860227-3-iscsi devstack@n-api.service[118907]: Gracefully killing worker 1 (pid: 118907)... Oct 31 14:55:44.549124 dv-cinder-860227-3-iscsi devstack@n-api.service[118908]: DEBUG dbcounter [-] [118908] Writing DB stats nova_api:SELECT=4 {{(pid=118908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:45.420426 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: worker 1 buried after 1 seconds Oct 31 14:55:45.420902 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: worker 2 buried after 1 seconds Oct 31 14:55:45.420902 dv-cinder-860227-3-iscsi devstack@n-api.service[118906]: goodbye to uWSGI. Oct 31 14:55:45.422129 dv-cinder-860227-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 31 14:55:45.423291 dv-cinder-860227-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 31 14:55:45.426211 dv-cinder-860227-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 14:55:45.442597 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 14:55:45 2022] *** Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: nodename: dv-cinder-860227-3-iscsi Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: machine: x86_64 Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: clock source: unix Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: pcre jit disabled Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: detected number of CPU cores: 4 Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: current working directory: / Oct 31 14:55:45.444624 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: detected binary path: /usr/bin/uwsgi-core Oct 31 14:55:45.445368 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: your processes number limit is 47680 Oct 31 14:55:45.445368 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: your memory page size is 4096 bytes Oct 31 14:55:45.445368 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: detected max file descriptor number: 2048 Oct 31 14:55:45.445368 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: lock engine: pthread robust mutexes Oct 31 14:55:45.445368 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: thunder lock: enabled Oct 31 14:55:45.445368 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 14:55:45.445368 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 14:55:45.485649 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: Python main interpreter initialized at 0x55c7051069c0 Oct 31 14:55:45.485649 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: python threads support enabled Oct 31 14:55:45.485649 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: your server socket listen backlog is limited to 100 connections Oct 31 14:55:45.485649 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: your mercy for graceful operations on workers is 90 seconds Oct 31 14:55:45.486141 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 14:55:45.486141 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: *** Operational MODE: preforking *** Oct 31 14:55:45.486371 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: *** uWSGI is running in multiple interpreter mode *** Oct 31 14:55:45.486371 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: spawned uWSGI master process (pid: 134327) Oct 31 14:55:45.486596 dv-cinder-860227-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 31 14:55:45.488704 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: spawned uWSGI worker 1 (pid: 134338, cores: 1) Oct 31 14:55:45.488704 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: spawned uWSGI worker 2 (pid: 134339, cores: 1) Oct 31 14:55:45.488704 dv-cinder-860227-3-iscsi devstack@n-api.service[134327]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 14:55:46.148681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 14:55:46.154729 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 14:55:47.398821 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:55:47.398821 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: from cryptography.utils import int_from_bytes Oct 31 14:55:47.399463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:55:47.399463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: from cryptography.utils import int_from_bytes Oct 31 14:55:47.414306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:55:47.414306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: from cryptography.utils import int_from_bytes Oct 31 14:55:47.414841 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:55:47.414841 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: from cryptography.utils import int_from_bytes Oct 31 14:55:49.837465 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 14:55:49.838009 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 14:55:49.838299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 14:55:49.838528 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 14:55:49.838786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 14:55:49.839172 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.839513 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.839845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.840169 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.840497 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.840808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.841125 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.841446 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.841772 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.842030 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.842341 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.842663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860227-3-iscsi {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.842982 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.843287 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.843613 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.843928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.844229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.845248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.845562 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.846055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.847412 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.847412 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.847412 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.847787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.848067 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.848389 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.848708 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.849021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.849324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.849648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.850033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860227-3-iscsi {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.850372 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.850674 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.851011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.851420 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.851738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.852063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.852371 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.852696 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.852995 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.853323 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.853641 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.853953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.854273 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.854574 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.854881 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.855188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.855505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.855833 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.856134 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.856388 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.856694 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.857013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.857330 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.857671 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.857895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.858142 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.858455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.858773 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.859079 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.859385 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.859715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.860659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.861044 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.861369 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.861673 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.861978 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.862296 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.862614 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.862946 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.863242 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.863578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.863990 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.864238 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.864547 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.864889 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.865214 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.865515 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.865833 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.866154 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.866468 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.866774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.867080 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.867395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.867755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.868182 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.868360 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.868594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.868897 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.869211 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.869514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.869917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.870118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.870415 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.870719 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.871042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.871324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.871663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.871974 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.872258 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.872562 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.872869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.873174 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.873666 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.873851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.874206 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.874391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.874696 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.875000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.875305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.875670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.875979 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.876284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.876611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.876915 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.877217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.877533 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.877838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.878145 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.878460 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.878757 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.879064 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.879416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.879707 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.880011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.880859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.880859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.881192 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.881192 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.881473 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.881756 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.882100 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.882360 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.882677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.883358 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.883358 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.883732 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.884098 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.884309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.884570 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.884912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.885221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.885552 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.885881 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.886198 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.886513 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.886826 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.886991 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 14:55:49.887463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.887646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 14:55:49.887806 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.887806 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.888086 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 14:55:49.888234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.888384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 14:55:49.888524 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.888664 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 14:55:49.888814 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.888965 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.889115 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.889256 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.889395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.889587 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.889742 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.889900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.890043 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.890192 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.890333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.890481 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.890630 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.890782 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.890923 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.891063 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.891246 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.891433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.891725 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.891994 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.892314 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.892472 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.892621 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.892765 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.892924 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860227-3-iscsi {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.893067 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.893209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.893349 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.893590 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.893737 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.893892 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.894063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.894444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.894620 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.894879 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.895130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.895286 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.895435 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.895618 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.895767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.895767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.896047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.896230 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.896374 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.896522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.896663 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.896811 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.896952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.897098 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.897247 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.897389 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.900016 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.900203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.900364 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.900519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.900680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.900822 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.900971 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.901122 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.901270 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.901426 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.901576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.901717 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.901871 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860227-3-iscsi {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.902029 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.902295 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.902579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.902730 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.902882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.902882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.903222 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.903362 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.903500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.903778 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.903938 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.904091 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.904240 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.904618 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.904769 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.905009 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.905181 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.905429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.905576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.905717 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.905864 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.906006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.906160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.906308 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.906449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.906598 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.906739 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.907426 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.907593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.907764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.907908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.908089 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.908267 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.908419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.908561 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.908707 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.908849 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.908997 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.909137 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.909291 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.909440 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.909588 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.909739 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.909879 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.910063 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.910226 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.910367 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.910507 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.910645 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.910798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.910949 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.911099 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.911246 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.911389 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.911389 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.911707 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.911861 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.912011 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.912153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.912378 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.912683 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.912844 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.912996 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.912996 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.913264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.913431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.913668 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.913905 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.914061 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.914211 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.914359 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.914517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.914869 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.915045 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.915279 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.915432 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.915593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.915831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.915997 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.916158 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.916307 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.917032 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.917194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.917337 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.917486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.917637 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.917637 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.917922 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.917922 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.918205 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.918346 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.918493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.918493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.918780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.918926 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.919075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.919216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.919372 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.919520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.919704 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.919848 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.919988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.920177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.920336 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.920495 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.920637 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.920785 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.920934 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.921074 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.921074 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.921348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.921348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.921348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.921348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.921861 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.922009 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.922158 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.922329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.923851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.924102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.924266 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.924410 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.924558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.925004 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.925163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.925323 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.925564 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.925720 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.925720 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.926124 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.926282 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.926429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.926585 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.926736 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.926876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.927016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.927155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.927304 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.927454 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.927636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.927793 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.927935 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.928083 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.928241 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.928391 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.928532 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.928680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.928680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.928963 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.929119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.929260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.929399 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.929399 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.929663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.929811 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.929951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.930107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.930290 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.930443 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.930583 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.930722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.930873 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.931014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.931160 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.931309 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.931450 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.931668 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.931825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.931977 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.932118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.932340 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.932486 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.932651 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.932865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.933016 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.933165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.933165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.933447 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.933586 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.933725 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.933999 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.934255 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.934403 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.934543 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.934691 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.935086 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.935250 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.935402 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.935578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.935807 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.935951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.936108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.936341 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.936505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.936674 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.936823 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.936971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.937112 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.937260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.937411 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.937552 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.937692 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.937832 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.937978 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.938186 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.938342 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.938342 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.938722 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.938866 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.939006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.939159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.939309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.939449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:55:49.939629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.939629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.939910 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.940060 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.940209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.940401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.940564 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.940705 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.940845 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.940994 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.941135 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.941284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.941431 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.941576 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.941730 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.941877 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.942031 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.942196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.942347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.942505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.942661 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.942817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.943054 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.943205 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.943351 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.943497 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.943714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.943873 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.944164 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.944409 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.944564 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.944718 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.944884 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.945249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.945403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.945551 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.945697 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.945872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.946110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.946265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.946512 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.946666 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.946813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.946968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.947127 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.947281 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.947437 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.947612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.947767 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.947927 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.948075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.948229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.948229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.948516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.948670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.948826 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.948981 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.949144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.949297 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.949444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.949599 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.949755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.949902 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.950047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.950200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.950354 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.950560 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.950716 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.950871 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.951025 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.951185 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.951331 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.951484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.951667 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.951816 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.951971 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.952143 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.952413 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.952591 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.952742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.952889 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.953060 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.953287 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.953459 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.953615 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.954421 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.954650 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.954803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.954949 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.955323 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.955323 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.955667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.955831 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.955990 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.956155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.956405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.956660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.956822 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.956979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.956979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.957260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.957422 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.957583 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.957732 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.957887 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.958034 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.958188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.958342 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.958508 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.958655 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.959325 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.959494 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.959710 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.959868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.960051 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.960205 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.960364 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.960551 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.960735 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.961139 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.961299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.961472 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.961620 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.961766 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.961912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.961912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.962209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.963059 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.963059 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.963456 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.963649 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.963812 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.963961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.964188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.964500 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.964682 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.964902 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.965062 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.965514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.965695 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.965853 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.966009 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.966156 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.966302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.966554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.966816 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.966970 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.967136 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.967284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.967441 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.968248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.968404 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.968552 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.968714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.968868 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.969014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.969160 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.969430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.970423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.970984 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.971152 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.971302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.971450 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.971627 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.971801 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.971950 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.971950 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.972234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.972234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.972525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.972695 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.972843 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.972998 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.973145 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.973299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.973465 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.973875 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.974035 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.974183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.974338 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.974648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.974812 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.975059 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.975226 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.975382 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.975826 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.975986 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.976143 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.976292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.976438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.976695 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.976960 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.977115 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.977272 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.977420 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.977567 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.977733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.977889 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.978036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.978192 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.978348 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.978504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.978659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.978809 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.978969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.979119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.979273 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.979420 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.979617 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.979783 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.979944 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.980092 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.980240 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.980393 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.980541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.980697 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.980860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.981066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.981215 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.981607 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.981769 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.981953 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.982117 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.982271 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.982427 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.982575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.982575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.983042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.983207 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.983364 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.983525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.983721 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.983809 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.984123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.984227 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.984313 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.984397 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.984486 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.984587 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.984850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.984991 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.985103 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.985189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.985417 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.985574 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.986654 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.986834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.986926 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.987709 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.987827 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.987926 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988197 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988373 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988464 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988550 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988722 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988722 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988892 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.988989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989157 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989238 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989410 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989507 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989600 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989685 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989768 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989941 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989941 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989941 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.989941 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.990263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.990355 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.990355 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.990525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.990609 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.990691 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.990773 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.990855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991008 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991195 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991279 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991362 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991451 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991544 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991647 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991730 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991826 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.991913 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992093 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992355 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992450 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992542 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992626 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.992964 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993059 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993143 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993495 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993670 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993670 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.993909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994226 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994311 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994393 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994568 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994776 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994879 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.994962 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.995043 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.995196 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.995283 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.995364 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.995445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.995526 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.995793 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.995911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.995993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996065 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996154 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996245 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996329 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996420 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996587 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996756 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996853 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.996938 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997023 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997267 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997447 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997612 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997693 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.997937 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998051 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998583 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998681 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998681 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.998922 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999012 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999103 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999359 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999441 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999617 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999708 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999864 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:49.999943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000092 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000232 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000308 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000308 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000751 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000839 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.000928 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001012 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001093 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001368 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001458 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001641 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001722 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001812 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.001986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002084 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002177 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002795 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.002969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003058 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003142 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003231 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003315 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003405 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003489 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003704 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003797 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003889 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.003988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004073 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004162 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004241 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004319 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004319 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004478 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004478 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004635 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004726 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.004810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.005128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.005227 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.005399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.005536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.005536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.005702 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.005926 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.006066 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.006231 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.006342 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.006342 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.006547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.006547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.006772 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.006883 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.006992 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.007109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.007220 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.007344 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.007496 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.007644 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.007759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.007902 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.008198 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.008319 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.008431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.008550 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.008668 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.008779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.008897 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.009041 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.009162 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.009356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.009476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.009669 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.009798 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.009980 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.010106 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.011459 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.011650 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.011793 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.011922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.012041 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.012153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.012271 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.012382 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.012554 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.012554 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.012748 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.012822 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.012898 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.013023 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.013112 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.013186 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.013255 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.013477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.013567 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.013758 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.013865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.013958 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.014043 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.014155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.014249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.014343 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.014416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.014536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.014682 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.014848 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.014953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.015164 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.015271 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.015477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.015612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.015815 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.015938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.016130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.016924 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.017053 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.017354 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.017511 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.017660 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.017822 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.017970 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.018194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.018337 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.018484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.018631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.018743 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.018869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.019012 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.019171 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.019318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.019533 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.019665 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.019760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.019852 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.019948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.020042 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.020163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.020286 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.020488 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.020601 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.020817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.020908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.021130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.021224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.021440 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.021540 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.021755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.021856 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.022067 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.022161 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.022376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.022472 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.022687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.022781 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.023000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.023092 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.023307 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.023403 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.023635 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.023744 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.023947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.024041 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.024252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.024341 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.024563 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.024677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.024871 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.024964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.025237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.025350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.025483 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.025586 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.025811 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.026011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.026231 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.026323 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.026424 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.026688 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.026804 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.027000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.027095 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.027336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.027431 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.027680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.027779 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.027999 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.028104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.028326 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.028431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.028642 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.028733 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.028961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.029066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.029276 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.029368 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.029593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.029688 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.029910 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.030016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.030219 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.030311 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.030531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.030669 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.030844 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.030944 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.031163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.031256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.031474 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.031640 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.031870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.032221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.032312 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.032543 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.032645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.032862 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.032968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.033190 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.033282 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.033517 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.033617 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.033847 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.033948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.034155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.034247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.034469 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.034609 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.034786 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.034888 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.035117 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.035210 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.035418 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.035521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.035755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.035862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.036074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.036177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.036392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.036496 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.036711 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.036805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.037035 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.037139 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.037351 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.037445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.037669 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.037788 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.037988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.038100 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.038299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.038407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.038613 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.038834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.039012 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.039203 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.039346 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.039532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.039692 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.039867 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.039970 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.040183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.040281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.040494 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.040592 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.040809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.040908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.041115 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.041280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.041427 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.041738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.041829 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.042055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.042158 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.042373 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.042476 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.042698 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.042792 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.043037 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.043137 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.043361 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.043455 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.043701 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.043810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.044019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.044125 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.044340 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.044432 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.044773 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.044872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.045094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.045195 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.045580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.045699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.045885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.045993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.046080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.046241 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.046342 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.046424 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.046638 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.046733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.046975 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.047092 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.047291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.048064 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.048190 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.048287 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.048545 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.048644 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.048764 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.048866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.049078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.049213 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.049401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.049501 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.049714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.049829 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.050028 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.050148 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.050352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.050455 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.050664 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.050873 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.051192 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.051284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.051511 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.051639 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.051867 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.052199 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.052425 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.052561 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.052761 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.052881 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.053096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.053190 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.053427 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.053530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.053740 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.053848 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.054067 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.054168 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.054377 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.054484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.054685 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.054778 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.054994 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.055087 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.055309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.055414 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.055643 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.055756 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.055951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.056067 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.056266 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.056368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.056594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.056698 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.056885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.057018 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.057248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.057349 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.057566 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.057660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.057898 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.057990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.058208 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.058310 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.058514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.058630 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.058864 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.058975 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.059173 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.059286 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.059487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.059624 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.059825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.059931 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.060161 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.060254 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.060478 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.060572 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.060794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.060896 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.061108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.061207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.061415 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.061506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.061728 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.061899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.062055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.062204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.062354 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.062499 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.062673 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.062831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.062995 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.063867 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.063867 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.064302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.064516 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.064611 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.064851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.064945 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.065172 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.065326 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.065504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.065598 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.065827 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.065947 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.066141 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.066241 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.066466 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.066573 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.066788 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.066900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.067111 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.067203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.067455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.067603 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.067816 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.068047 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.068151 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.068388 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.068482 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.068715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.068808 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.069058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.069167 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.069395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.069516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.069708 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.069815 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.070024 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.070123 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.070335 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.070427 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.070648 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.070739 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.070964 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.071064 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.071280 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.071396 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.071611 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.071708 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.071924 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.072033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.072239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.072331 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.072546 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.072638 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.072858 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.073025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.073168 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.073258 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.073482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.073575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.073793 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.073922 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.074103 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.074207 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.074415 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.074517 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.074727 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.074827 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.075036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.075137 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.075343 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.075433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.075719 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.075827 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.076035 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.076148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.076355 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.076446 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.076673 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.076768 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.076997 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.077103 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.077308 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.077414 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.077623 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.077724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.077934 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.078028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.078247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.078354 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.078568 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.078679 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.078924 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.079013 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.079334 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.079443 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.079679 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.079772 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.080006 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.080128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.080331 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.080433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.080657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.080754 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.081070 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.081209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.081384 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.081541 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.081706 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.081880 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.082032 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.082181 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.082350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.082503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.082674 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.082826 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.082987 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.083146 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.083320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.083464 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.083683 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.083807 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.084016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.084115 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.084346 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.084440 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.084656 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.084757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.084965 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.085081 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.085272 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.085371 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.085582 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.085709 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.086196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.086315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.086465 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.086599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.086771 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.086923 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.087085 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.087254 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.087374 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.087714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.087833 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.087956 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.088060 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.088270 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.088365 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.088580 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.088671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.088891 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.088996 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.089197 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.089306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.089501 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.089594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.089807 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.089947 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.090120 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.090259 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.090437 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.090539 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.090739 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.090831 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.091049 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.091144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.091356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.091500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.091686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.091782 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.091992 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.092086 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.092298 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.092399 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.092603 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.092702 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.092935 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.093037 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.093260 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.093362 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.093576 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.093676 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.093901 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.094098 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.094199 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.094537 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.094719 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.094885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.095036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.095218 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.095363 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.095567 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.095716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.095895 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.096036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.096222 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.096377 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.096555 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.096672 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.096868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.096997 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.097189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.097293 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.097505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.097599 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.097821 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.097925 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.098129 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.098232 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.098454 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.098548 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.098767 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.098859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.099076 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.099178 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.099400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.099504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.099738 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.099832 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.100058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.100274 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.100375 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.100632 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.100726 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.100956 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.101061 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.101288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.101388 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.101608 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.101700 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.101924 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.102025 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.102234 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.102328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.102548 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.102648 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.102858 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.102963 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.103167 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.103260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.103478 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.103599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.103816 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.103912 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.104124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.104216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.104433 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.104526 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.104749 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.104842 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.105063 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.105155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.105370 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.105465 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.105684 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.105786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.105992 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.106092 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.106324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.106464 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.106634 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.106731 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.106946 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.107047 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.107261 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.107407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.107594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.107703 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.107903 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.108009 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.108213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.108316 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.108475 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 14:55:50.108569 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.108816 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.109131 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.109443 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.109752 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.110588 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.110904 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.111269 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.111605 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.111919 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.112249 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.112560 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.112868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.113188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.113503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.113829 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.114146 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.114463 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.114815 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.115136 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.115694 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.116033 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.116361 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.116701 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.117043 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.117359 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.117671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.117998 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.118302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.118617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.118932 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.119246 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.119575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.119889 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.120201 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.120513 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.120826 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.121136 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.121450 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.121763 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.122076 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.122387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.122698 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.123018 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.123361 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.123711 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.124038 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.124356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.124675 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.124988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.125301 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.126261 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.126642 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.126914 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.127250 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.127609 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.127901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.128332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.128649 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.128974 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.129299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.129615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.129939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.130269 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.130587 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.130914 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.131229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.131584 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.131925 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.132259 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.132590 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.132898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.133206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.133514 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.133824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.134145 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.134458 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.134764 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.135071 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.135381 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.135717 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.136026 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.136331 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.136638 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.136956 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.137260 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.137572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.137878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.138210 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.138486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.138789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.139098 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.139405 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.139739 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.140044 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.140351 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.140656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.140991 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.141357 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.141722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.142001 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.142318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.142645 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.142958 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.143285 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.143638 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.143963 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.144276 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.144614 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.144927 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.145244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.145561 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.145876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.146188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.146500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.146830 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.147165 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.147474 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.147829 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.148151 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.148479 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.148796 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.149114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.149447 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.149762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.150076 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.150387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.150703 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.151020 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.151342 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.151680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.151997 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.152316 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.152652 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.152969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.153301 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.153616 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.153945 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.154276 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.154624 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.154942 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.155291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.155643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.155965 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.156284 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.156595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:55:50.156867 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 14:55:50.171949 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO dbcounter [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Registered counter for database nova_api Oct 31 14:55:50.193145 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_db.sqlalchemy.engines [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:55:50.199817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writer thread running {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:55:50.221079 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO dbcounter [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Registered counter for database nova_api Oct 31 14:55:50.241720 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_db.sqlalchemy.engines [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:55:50.248469 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writer thread running {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:55:50.257314 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.context [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d73f737-e281-44b5-9222-e10716a9638b(cell1) {{(pid=134339) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 14:55:50.261413 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:55:50.261892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:55:50.263481 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:55:50.264236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:55:50.264686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:55:50.266756 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:55:50.268784 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO dbcounter [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Registered counter for database nova_cell0 Oct 31 14:55:50.272981 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO dbcounter [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Registered counter for database nova_cell1 Oct 31 14:55:50.280259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_db.sqlalchemy.engines [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:55:50.282110 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_db.sqlalchemy.engines [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:55:50.288068 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writer thread running {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:55:50.290166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writer thread running {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:55:50.306404 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.context [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d73f737-e281-44b5-9222-e10716a9638b(cell1) {{(pid=134338) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 14:55:50.310452 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:55:50.310931 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:55:50.312546 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:55:50.313855 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:55:50.314309 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:55:50.316357 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:55:50.318379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO dbcounter [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Registered counter for database nova_cell0 Oct 31 14:55:50.322504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO dbcounter [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Registered counter for database nova_cell1 Oct 31 14:55:50.329886 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_db.sqlalchemy.engines [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:55:50.332551 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_db.sqlalchemy.engines [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:55:50.337065 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writer thread running {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:55:50.342888 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writer thread running {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:55:50.437434 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO dbcounter [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Registered counter for database nova_cell0 Oct 31 14:55:50.444458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_db.sqlalchemy.engines [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:55:50.449609 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writer thread running {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:55:50.488036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO dbcounter [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Registered counter for database nova_cell0 Oct 31 14:55:50.495137 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_db.sqlalchemy.engines [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:55:50.499939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writer thread running {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:55:50.790347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: WARNING keystonemiddleware.auth_token [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:55:50.797718 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: WARNING keystonemiddleware.auth_token [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:55:50.827068 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: WARNING keystonemiddleware.auth_token [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:55:50.835186 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: WARNING keystonemiddleware.auth_token [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:55:51.145744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: WARNING keystonemiddleware.auth_token [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:55:51.151696 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: WARNING keystonemiddleware.auth_token [None req-2e429527-b7ee-4c8d-822c-61d7bd72c146 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:55:51.157058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7051069c0 pid: 134339 (default app) Oct 31 14:55:51.183341 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: WARNING keystonemiddleware.auth_token [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 14:55:51.189996 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: WARNING keystonemiddleware.auth_token [None req-428f2aaa-fd44-41c5-9114-2787c3509a98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 14:55:51.195289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7051069c0 pid: 134338 (default app) Oct 31 14:56:26.301179 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=3 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:26.302743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=3 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:26.303716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=3 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:26.304861 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=3 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:27.373622 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7a6cf824-db0b-4419-be57-c05f4e893302 tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] Action: 'create', calling method: .version_select at 0x7f6c71ee0ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-565874930", "metadata": {"Type": "work"}}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:30.299275 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7a6cf824-db0b-4419-be57-c05f4e893302 tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.005027 Oct 31 14:56:30.310352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1156 bytes} [Mon Oct 31 14:56:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4017 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 14:56:30.753955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e9e10486-b5ab-450d-b08d-af705042764b tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] Calling method '.version_select at 0x7f6c71f3f040>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:30.823020 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:30.824574 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:30.825839 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:30.827793 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:31.696053 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e9e10486-b5ab-450d-b08d-af705042764b tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9" status: 200 len: 353 microversion: 2.1 time: 1.383525 Oct 31 14:56:31.710137 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 1/2] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 14:56:30 2022] GET /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9 => generated 353 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:56:31.714318 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0d0d78e7-c5c3-4d32-aae9-d234890cab11 tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] Calling method '.version_select at 0x7f6c71d66d30>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:31.816551 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0d0d78e7-c5c3-4d32-aae9-d234890cab11 tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9" status: 200 len: 353 microversion: 2.1 time: 0.106646 Oct 31 14:56:31.830565 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 14:56:31 2022] GET /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:56:31.836449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4bd36bcf-e1ce-4137-a95b-53de8fc37b52 tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] Calling method '.version_select at 0x7f6c71d98dc0>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:31.940920 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4bd36bcf-e1ce-4137-a95b-53de8fc37b52 tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9" status: 202 len: 0 microversion: 2.1 time: 0.108620 Oct 31 14:56:31.942244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 14:56:31 2022] DELETE /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:56:31.950773 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4061e7e6-2df9-4da2-8bbe-45bb2ab4dc88 tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] Calling method '.version_select at 0x7f6c71cf9430>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:32.039260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4061e7e6-2df9-4da2-8bbe-45bb2ab4dc88 tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9" status: 200 len: 352 microversion: 2.1 time: 0.092513 Oct 31 14:56:32.040441 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 14:56:31 2022] GET /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:56:33.054199 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-86292f50-7bc9-477e-a5db-91801172291d tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] Calling method '.version_select at 0x7f6c71d98c10>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:33.316657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-86292f50-7bc9-477e-a5db-91801172291d tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] HTTP exception thrown: Volume 6a641989-abc3-455d-ba8a-fdd079ed27f9 could not be found. Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-86292f50-7bc9-477e-a5db-91801172291d tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] Request method failure captured: Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9 HTTP/1.1 Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-IahbQQRoi62i0tljVf8_jfD1XgQm3oiUkPyd0DiD2U4Dipp3fmozJe_9-8xVs2_IWYCyAluQqfIfMuiU3tiN2ramsmODGr46_-WQy0s-Yh_y8Pph8iyVEqZP14eSVr2Sp8jKohNQ0xIvi6yL2Ho8Olh2CvsJ_NymoSfkrnGgMXOBQ Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 713e15a5407049b2a8efd3ec38cd26cf Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-VolumesGetTestJSON-106022975 Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 14:56:33.320714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/713e15a5407049b2a8efd3ec38cd26cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/713e15a5407049b2a8efd3ec38cd26cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_713e15a5407049b2a8efd3ec38cd26cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/713e15a5407049b2a8efd3ec38cd26cf"}]}] Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-VolumesGetTestJSON-106022975 Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 713e15a5407049b2a8efd3ec38cd26cf Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-VolumesGetTestJSON-106022975 Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-VolumesGetTestJSON-106022975-project Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: 78dbaf070ba94a0894cecc104ab26e42 Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-VolumesGetTestJSON-106022975-project Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Volume 6a641989-abc3-455d-ba8a-fdd079ed27f9 could not be found. Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '6a641989-abc3-455d-ba8a-fdd079ed27f9'} Oct 31 14:56:33.322126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a641989-abc3-455d-ba8a-fdd079ed27f9 could not be found. (HTTP 404) (Request-ID: req-cf12d85a-5213-4968-8afe-8f17fabfae22) Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:56:33.322981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:56:33.324237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a641989-abc3-455d-ba8a-fdd079ed27f9 could not be found. Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 14:56:33.325329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a641989-abc3-455d-ba8a-fdd079ed27f9 could not be found. Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a641989-abc3-455d-ba8a-fdd079ed27f9 could not be found. Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-86292f50-7bc9-477e-a5db-91801172291d tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] Returning 404 to user: Volume 6a641989-abc3-455d-ba8a-fdd079ed27f9 could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-86292f50-7bc9-477e-a5db-91801172291d tempest-VolumesGetTestJSON-106022975 tempest-VolumesGetTestJSON-106022975-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9" status: 404 len: 109 microversion: 2.1 time: 0.271883 Oct 31 14:56:33.326505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 14:56:33 2022] GET /compute/v2.1/os-volumes/6a641989-abc3-455d-ba8a-fdd079ed27f9 => generated 109 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:56:38.069373 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1281088818", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "networks": [{"uuid": "62d09c23-95fd-46cc-ac62-b206a226f4d0"}]}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:38.389146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] validate_networks() for [('62d09c23-95fd-46cc-ac62-b206a226f4d0', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:56:42.433667 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2e74f95a-3d90-48ef-bb1b-ff3c6dc7d1d7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'create', calling method: .version_select at 0x7f6c7253aaf0>, body: {"keypair": {"name": "tempest-keypair-1610460469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiOgxtygSMADmK0jFwn2s/zplrIg7zRzHqaKw0/gkwLC6owdo6/JiADKaJyiTIgjqE3JsBdrhZNbGESXKBD2Y1gBi+zg1nQXTrt6hh4rXsrct6JeDy0NiZk/VJMn75s8w=="}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:42.579455 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-2e74f95a-3d90-48ef-bb1b-ff3c6dc7d1d7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Getting quotas for project 5119fe6e3c064da0a66218481a944aaa. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:56:42.604000 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-2e74f95a-3d90-48ef-bb1b-ff3c6dc7d1d7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Getting quotas for user e1fb0b1657cd43baaa93a16ce6d9ec8f and project 5119fe6e3c064da0a66218481a944aaa. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:56:42.739949 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2e74f95a-3d90-48ef-bb1b-ff3c6dc7d1d7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.792294 Oct 31 14:56:42.741824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 4/7] 10.222.0.36 () {62 vars in 1200 bytes} [Mon Oct 31 14:56:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 796 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 31 14:56:43.302096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:56:43.302639 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:56:43.303008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:56:43.305116 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:56:43.305619 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:56:43.357810 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:43.360892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:43.362574 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:43.364406 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:43.365268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:43.367182 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:43.500022 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Getting quotas for project af86d70d54694b7995d03c8c607ae706. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:56:43.526415 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Getting quotas for user 77af489d5daa4d028b737c5f4efc93db and project af86d70d54694b7995d03c8c607ae706. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:56:43.556736 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-63e0f62f-ea35-46da-bfd9-8f0b66a4b3d9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'create', calling method: .version_select at 0x7f6c71c45280>, body: {"keypair": {"name": "tempest-keypair-1040567426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL92eeCp3GmjUxuF2ddH5E4QaVeTCP3umX22qG4JmszAiyXIArMK9njSp0N8fEGCvMf51Z+4Nai/US5TsaumtCli76n3axFqrDQcH1EzqqTVap92D7iVeM/go5fDxF7vQQ=="}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:43.581640 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:56:43.595307 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:56:43.598291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-63e0f62f-ea35-46da-bfd9-8f0b66a4b3d9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Getting quotas for project fdab2d4f39c64f239ded71cc9773c8bb. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:56:43.612518 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-63e0f62f-ea35-46da-bfd9-8f0b66a4b3d9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Getting quotas for user 75d1901be8064ff5bf79f0268d589e10 and project fdab2d4f39c64f239ded71cc9773c8bb. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:56:43.675520 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-63e0f62f-ea35-46da-bfd9-8f0b66a4b3d9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.551483 Oct 31 14:56:43.685571 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 5/8] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 14:56:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:56:43.754018 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7e0c07ca-5434-47ef-9e8e-9ded8c18ce8b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.121194 Oct 31 14:56:43.756104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 4/9] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:56:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 6124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 14:56:43.769332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7104d43a-a65c-44ea-a279-6f7bb3c001a9 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:43.770347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7104d43a-a65c-44ea-a279-6f7bb3c001a9 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:44.105822 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7104d43a-a65c-44ea-a279-6f7bb3c001a9 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:44.131053 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7104d43a-a65c-44ea-a279-6f7bb3c001a9 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1215 microversion: 2.1 time: 0.366377 Oct 31 14:56:44.133681 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 6/10] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:43 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1215 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:45.166419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a5041230-fd65-4c3d-ac9f-69fb288885e9 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:45.167691 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a5041230-fd65-4c3d-ac9f-69fb288885e9 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:45.514511 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a5041230-fd65-4c3d-ac9f-69fb288885e9 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:45.553374 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a5041230-fd65-4c3d-ac9f-69fb288885e9 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1215 microversion: 2.1 time: 0.397461 Oct 31 14:56:45.553960 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 5/11] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:45 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1215 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:46.583322 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:46.584023 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:46.594555 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:46.598948 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:46.599436 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:46.600229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:46.600717 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:46.601148 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:46.975647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:46.990960 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8ef3cb69-5418-4598-9187-e0850b0afc73 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1219 microversion: 2.1 time: 0.411890 Oct 31 14:56:46.992193 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:46 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1219 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:48.021575 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:48.023155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:48.046604 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:48.047155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:48.047967 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:48.052911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:48.054893 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:48.055573 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:48.507265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:48.531754 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2d61c092-2a1d-4c1f-a90c-7fb42480bcb4 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1211 microversion: 2.1 time: 0.514655 Oct 31 14:56:48.547581 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 6/13] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:48 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1211 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:56:48.781905 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1718480034", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5834683c-3d1a-4deb-b1fe-c3f585ecb7f7"}], "security_groups": [{"name": "tempest-securitygroup--1912002241"}], "key_name": "tempest-keypair-1610460469", "user_data": "}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:49.209951 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] validate_networks() for [('5834683c-3d1a-4deb-b1fe-c3f585ecb7f7', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:56:49.563611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:49.564836 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:49.588462 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:49.593218 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:49.593808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:49.604838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:49.605714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:49.608347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:50.236977 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:50.250188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0b1e04a5-b388-4d01-be4b-23e5068e005a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1273 microversion: 2.1 time: 0.691867 Oct 31 14:56:50.252593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 7/14] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:49 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1273 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:51.278975 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:51.282017 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:51.306607 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:51.308145 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:51.310732 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:51.313798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:51.326680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:51.328494 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:51.729849 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:51.752569 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9f158fd7-05f7-43c0-b86e-4753663e95e5 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1273 microversion: 2.1 time: 0.479840 Oct 31 14:56:51.753457 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:51 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1273 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:56:52.737740 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:56:52.738272 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:56:52.738634 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:56:52.739041 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:56:52.739449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:56:52.764604 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:52.765256 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:52.765706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:52.773321 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:52.773321 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:52.777229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:52.888095 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Getting quotas for project 5119fe6e3c064da0a66218481a944aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:56:52.907390 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Getting quotas for user e1fb0b1657cd43baaa93a16ce6d9ec8f and project 5119fe6e3c064da0a66218481a944aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:56:52.944362 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:56:52.960142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:56:53.111233 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e759a282-23f9-4208-9612-f417b288b61e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.345252 Oct 31 14:56:53.116752 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 8/16] 10.222.0.36 () {62 vars in 1188 bytes} [Mon Oct 31 14:56:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 4353 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 14:56:53.136765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:53.141803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:53.167467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:53.168409 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:53.169030 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:53.171307 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:53.173148 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:53.174300 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:53.443972 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:53.600306 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0ca7e16a-18ed-4e09-8aa6-5066fc23b37f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: .version_select at 0x7f6c71337310>, body: {"keypair": {"name": "tempest-keypair-1546437633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOWaNL8qFJuGQHN0eigy30bq9SmgYJDvDBXYZqGSLDv98H0ndnjbMqUoBhpPlS2auQFpy2kilpSjtPE9oF0TRllak0l4mZwGSO1zUG3tHT1muUS6tH1NqsqaHdQEY8wFQ=="}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:53.640250 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-0ca7e16a-18ed-4e09-8aa6-5066fc23b37f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for project f629aa044ca845069237ecb8d889284e. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:56:53.645138 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-0ca7e16a-18ed-4e09-8aa6-5066fc23b37f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for user cdcbcb2ed9e44dbe8444e531fc1eb707 and project f629aa044ca845069237ecb8d889284e. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:56:53.710859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0ca7e16a-18ed-4e09-8aa6-5066fc23b37f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.260697 Oct 31 14:56:53.711948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 9/17] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 14:56:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:56:53.764163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:53.784595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6eb0e73c-09a8-4d02-bf9c-25ca9ed24195 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1273 microversion: 2.1 time: 0.665958 Oct 31 14:56:53.788928 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:53 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1273 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:53.803893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5ff18d35-8893-4de3-af29-10f4b73761a4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:53.820832 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5ff18d35-8893-4de3-af29-10f4b73761a4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:54.065999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5ff18d35-8893-4de3-af29-10f4b73761a4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:54.084019 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5ff18d35-8893-4de3-af29-10f4b73761a4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:54.092263 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5ff18d35-8893-4de3-af29-10f4b73761a4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:54.098301 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5ff18d35-8893-4de3-af29-10f4b73761a4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1282 microversion: 2.20 time: 0.303468 Oct 31 14:56:54.113149 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 10/19] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:56:53 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1282 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:56:54.196530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1299803876", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:54.360616 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] validate_networks() for [('03bb4962-9fda-452b-81f0-eb5044fdf378', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:56:54.811056 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:54.811949 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:54.894293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:54.901883 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:54.906151 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:54.907159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:54.916240 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:54.920496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:56.160250 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:56.171043 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9d5b3367-c542-450c-99fe-474405cc92ff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 1.364632 Oct 31 14:56:56.179414 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:54 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:56.220486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:56.225538 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:56.270744 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:56.271174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:56.276647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:56.277557 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:56.279515 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:56.280058 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:56.477452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:56:56.478471 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:56:56.479429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:56:56.480895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:56:56.482384 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:56:56.560248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:56.561151 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:56.561686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:56.563867 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:56.565624 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:56.572953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:56.605651 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:56.620657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:56.623260 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:56.636191 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-74099e01-b800-4977-8fea-d681369dac7f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1278 microversion: 2.20 time: 0.455148 Oct 31 14:56:56.641047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 12/21] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:56:56 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1278 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:56:56.668979 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Getting quotas for project 8bc7c0eaebf146bea1af6b4d708bf62b. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:56:56.690635 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-13579625", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9dc557c-0645-443c-a01e-416bcfdc6824"}], "security_groups": [{"name": "tempest-securitygroup--819047960"}], "key_name": "tempest-keypair-1040567426", "user_data": "}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:56.696868 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Getting quotas for user e6bfe2c1ba054935ae8e9fcc054faf68 and project 8bc7c0eaebf146bea1af6b4d708bf62b. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:56:56.777484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:56:56.780328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:56:56.963465 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7cecea2d-6397-4188-bf91-88db20042715 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.250114 Oct 31 14:56:56.967059 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 10/22] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:56:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 3255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:56:56.979233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-245dbe36-d843-40d4-b1c7-2a9c478af449 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:56.980194 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-245dbe36-d843-40d4-b1c7-2a9c478af449 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:57.231298 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-245dbe36-d843-40d4-b1c7-2a9c478af449 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:57.245698 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-245dbe36-d843-40d4-b1c7-2a9c478af449 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1222 microversion: 2.1 time: 0.267823 Oct 31 14:56:57.246667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 11/23] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:56 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1222 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:56:57.292869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:57.293917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:57.314202 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:57.315757 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:57.317880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:57.318907 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:57.321739 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:57.323222 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:58.095666 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:58.114376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a315c387-1f4c-4a4f-9622-0b85d72be19b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.863374 Oct 31 14:56:58.124521 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:56:57 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:56:58.132010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:56:58.132882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:56:58.206805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:58.208247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:58.208702 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:58.212050 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:56:58.212531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:56:58.212968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:56:58.250194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] validate_networks() for [('d9dc557c-0645-443c-a01e-416bcfdc6824', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:56:58.876585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:58.908499 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:58.921901 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:56:58.925699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0d242b75-db3b-448f-a53f-c17c3a71c386 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1340 microversion: 2.20 time: 0.799280 Oct 31 14:56:58.954018 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 13/25] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:56:58 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1340 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:56:58.998446 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-46188959", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:56:59.199304 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] validate_networks() for [('03bb4962-9fda-452b-81f0-eb5044fdf378', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:57:00.778775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:57:00.788028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:57:00.789109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:57:00.789375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:57:00.789927 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:57:00.818200 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:00.823900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:00.826898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:00.828038 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:00.831223 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:00.831881 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:00.893761 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Getting quotas for project fdab2d4f39c64f239ded71cc9773c8bb. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:57:00.903943 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Getting quotas for user 75d1901be8064ff5bf79f0268d589e10 and project fdab2d4f39c64f239ded71cc9773c8bb. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:57:00.938377 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:57:00.944323 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:57:01.046185 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9d5621e8-00fe-4208-abab-af0528972e71 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.360451 Oct 31 14:57:01.053587 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 13/26] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:56:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 4369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:57:01.065439 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:01.066326 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:01.084269 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:01.085398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:01.085999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:01.088957 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:01.094557 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:01.095193 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:03.053294 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:03.065307 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4d6c101a-5270-4ccf-8a11-448540428026 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 2.010344 Oct 31 14:57:03.076575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:01 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:03.094094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:03.097022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:03.129228 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:03.136919 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:03.141386 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:03.153965 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:03.163798 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:03.164253 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:03.269393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:57:03.269393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:57:03.269393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:57:03.269393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:57:03.269393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:57:03.306751 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:03.307261 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:03.307731 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:03.308462 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:03.308984 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:03.309669 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:03.441894 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Getting quotas for project 8bc7c0eaebf146bea1af6b4d708bf62b. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:57:03.461402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Getting quotas for user e6bfe2c1ba054935ae8e9fcc054faf68 and project 8bc7c0eaebf146bea1af6b4d708bf62b. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:57:03.490845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:57:03.493954 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:57:03.629413 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ad970b0a-87bb-49e1-92fc-20ae14a9f844 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.670192 Oct 31 14:57:03.651996 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 14/28] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:56:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 4696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:57:03.659170 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:03.672772 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:03.680799 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:03.681298 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:03.681745 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:03.682456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:03.688226 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:03.694817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:03.818903 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:03.830859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:03.837115 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:03.848020 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-82003992-38a0-428a-a29a-57fdb2bc8453 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1340 microversion: 2.20 time: 0.767842 Oct 31 14:57:03.849447 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 15/29] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:03 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1340 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:03.854400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ff8a534c-9dc1-4e33-9eca-d4a22d3c0266 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:03.855021 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ff8a534c-9dc1-4e33-9eca-d4a22d3c0266 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:04.260808 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ff8a534c-9dc1-4e33-9eca-d4a22d3c0266 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:04.271493 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ff8a534c-9dc1-4e33-9eca-d4a22d3c0266 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1220 microversion: 2.1 time: 0.421058 Oct 31 14:57:04.275137 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 16/30] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:03 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1220 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:04.597540 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:04.610919 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7925ba23-0c38-4986-ac47-2c233e6740e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1288 microversion: 2.1 time: 0.956686 Oct 31 14:57:04.611886 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 15/31] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:03 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1288 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:04.627882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:04.629060 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:04.640195 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:04.649691 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:04.650431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:04.651334 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:04.651971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:04.653146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:04.678928 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-dedea39b-856b-42ed-b484-193e8fdfcd07 req-08e1aced-6a2d-4f7a-9c3f-4fcf091405fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c93f4d-15ed-4113-95ad-b6766332779e", "tag": "3f33f9e8-094c-4cdc-84e0-fcaac96a6b7a"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:04.707263 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-dedea39b-856b-42ed-b484-193e8fdfcd07 req-08e1aced-6a2d-4f7a-9c3f-4fcf091405fc service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:04.708048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-dedea39b-856b-42ed-b484-193e8fdfcd07 req-08e1aced-6a2d-4f7a-9c3f-4fcf091405fc service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:04.712358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-dedea39b-856b-42ed-b484-193e8fdfcd07 req-08e1aced-6a2d-4f7a-9c3f-4fcf091405fc service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:04.770583 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-dedea39b-856b-42ed-b484-193e8fdfcd07 req-08e1aced-6a2d-4f7a-9c3f-4fcf091405fc service nova] Creating event network-changed:3f33f9e8-094c-4cdc-84e0-fcaac96a6b7a for instance f1c93f4d-15ed-4113-95ad-b6766332779e on hv-cinder-86022 Oct 31 14:57:04.773313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-dedea39b-856b-42ed-b484-193e8fdfcd07 req-08e1aced-6a2d-4f7a-9c3f-4fcf091405fc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=134338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:57:04.775656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-dedea39b-856b-42ed-b484-193e8fdfcd07 req-08e1aced-6a2d-4f7a-9c3f-4fcf091405fc service nova] Acquired lock "compute-rpcapi-router" {{(pid=134338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:57:04.779075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-222bed98-4820-4cab-92ca-65918e1ab528 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:04.785434 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-222bed98-4820-4cab-92ca-65918e1ab528 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:04.786300 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-222bed98-4820-4cab-92ca-65918e1ab528 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:04.787962 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-222bed98-4820-4cab-92ca-65918e1ab528 None None] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:04.788685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-222bed98-4820-4cab-92ca-65918e1ab528 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:04.789338 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-222bed98-4820-4cab-92ca-65918e1ab528 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:04.822844 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.compute.rpcapi [None req-222bed98-4820-4cab-92ca-65918e1ab528 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 31 14:57:04.825344 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-222bed98-4820-4cab-92ca-65918e1ab528 None None] Releasing lock "compute-rpcapi-router" {{(pid=134338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:57:04.851515 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-222bed98-4820-4cab-92ca-65918e1ab528 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.561538 Oct 31 14:57:04.852952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:04.877617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:04.878940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:04.891907 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:04.895108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:04.896099 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:04.898239 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:04.900726 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:04.915617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:05.112104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:05.130915 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-27f9f2c6-acc1-455d-8998-2384a4655d47 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.513195 Oct 31 14:57:05.133244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 16/33] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:04 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:05.294321 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:05.303281 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:05.303954 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:05.317569 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:05.318160 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:05.318663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:05.319318 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:05.326202 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:05.326911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:05.332868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:05.341528 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:05.345451 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-287baaaf-7867-447a-a870-341758b1716f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1340 microversion: 2.20 time: 0.472807 Oct 31 14:57:05.346043 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 18/34] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:04 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1340 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:57:05.653306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:05.654009 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:05.671746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:05.673707 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:05.674235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:05.676953 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:05.679267 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:05.681133 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:05.850394 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:05.864214 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-07afe07b-f5bc-408e-be51-a4f434393842 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1272 microversion: 2.1 time: 0.565629 Oct 31 14:57:05.868548 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 17/35] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:05 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1272 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:06.174742 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:06.176568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:06.189644 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:06.191486 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:06.192519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:06.196492 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:06.197687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:06.198407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:06.282210 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:06.293884 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-177d5205-28f2-4a29-812f-e7d4edc20994 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1294 microversion: 2.1 time: 0.644547 Oct 31 14:57:06.313611 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 19/36] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:05 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1294 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:06.350659 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-915520330", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "344848ef-d9a5-4f9a-8ddf-c96c364ed358"}], "security_groups": [{"name": "tempest-securitygroup--2123572476"}], "key_name": "tempest-keypair-1546437633", "user_data": "}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:06.820892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:06.821875 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] validate_networks() for [('344848ef-d9a5-4f9a-8ddf-c96c364ed358', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:57:06.839178 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-597a1b46-d89c-4ace-8266-a3de9f50603b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.670258 Oct 31 14:57:06.840868 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 18/37] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:06 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:06.853982 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:06.856122 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:06.883783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:06.884280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:06.884768 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:06.885510 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:06.885967 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:06.886475 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:07.318528 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:07.327937 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:07.338108 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:07.340148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3043757e-c57c-41b2-b181-bfa15f1c4d71 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.495825 Oct 31 14:57:07.342240 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 19/38] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:06 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:07.357009 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:07.359968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:07.375611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:07.376314 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:07.380346 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:07.381425 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:07.382053 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:07.382661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:07.688336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:07.690754 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=71 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:07.705233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1ed2fd3b-6490-4436-aabc-2000ed7566ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1278 microversion: 2.1 time: 0.358716 Oct 31 14:57:07.706097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 20/39] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:07 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1278 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:07.718953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:07.719814 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:07.722181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:07.736973 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:07.737813 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:07.738407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:07.739334 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:07.739969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:07.740541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:07.913827 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:07.924490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0af6163c-5b2c-4378-bc6b-1d25cc8b2b3d tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1294 microversion: 2.1 time: 0.217019 Oct 31 14:57:07.926099 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 21/40] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:07 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1294 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:07.932672 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:07.933853 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:07.944427 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:07.945354 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:07.946067 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:07.946888 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:07.947352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:07.947814 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:08.427010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:08.448168 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-43d5cb79-61e2-449e-82d9-bfb08036023c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.515463 Oct 31 14:57:08.448821 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 22/41] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:07 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:08.462878 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:08.465416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:08.482780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:08.484082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:08.485451 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:08.486891 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:08.493403 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:08.494430 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:08.662129 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:57:08.663134 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:57:08.663843 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:57:08.664486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:57:08.665125 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:57:08.685893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:08.686716 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:08.687380 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:08.688354 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:08.690130 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:08.693285 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:08.725540 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for project f629aa044ca845069237ecb8d889284e. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:57:08.728671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:08.733626 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for user cdcbcb2ed9e44dbe8444e531fc1eb707 and project f629aa044ca845069237ecb8d889284e. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:57:08.755306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:57:08.758230 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:57:08.854584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:08.876843 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9ea41a23-70d2-4992-8918-e42aaf7758e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.533514 Oct 31 14:57:08.878788 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 20/42] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:57:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:57:08.889221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:08.891086 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:08.891965 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:08.904456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:08.906428 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f3eea009-bae9-4f7c-b6cd-f1c27b312ab7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.451681 Oct 31 14:57:08.906551 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:08.907940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:08.910202 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:08.911124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:08.911883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 23/43] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:08 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:08.916502 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:08.917255 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:08.932897 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4227206d-e6d9-412b-8647-14b85851148b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:08.934831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4227206d-e6d9-412b-8647-14b85851148b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:09.118759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4227206d-e6d9-412b-8647-14b85851148b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:09.125864 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=27 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:09.135830 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4227206d-e6d9-412b-8647-14b85851148b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1241 microversion: 2.1 time: 0.213540 Oct 31 14:57:09.137931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 24/44] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:08 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1241 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:09.151719 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:09.156420 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:09.178907 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:09.179401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:09.186648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:09.187682 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:09.188457 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:09.189065 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:09.854656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:09.868281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-feab9d7a-22a6-4e5a-a164-fde5ab935d2d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1278 microversion: 2.1 time: 0.988245 Oct 31 14:57:09.882370 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 21/45] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:08 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1278 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:09.889898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:09.890814 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:09.898532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:09.899292 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:09.900055 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:09.900966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:09.901629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:09.902864 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:10.653887 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:10.665264 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-262bfa75-eb0b-4c56-bef6-dbe48fa7e2bf tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 1.525234 Oct 31 14:57:10.666436 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 25/46] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:09 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:10.691987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:10.708892 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f0c253d4-8421-46c5-8f13-a9a404b24731 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.823739 Oct 31 14:57:10.710086 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 22/47] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:09 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:10.731481 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:10.735382 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:10.749526 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:10.750033 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:10.750472 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:10.752624 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:10.753417 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:10.755979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:10.877291 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-30ae0961-93db-4cb3-ad49-110a2161aa49 req-6a8e1621-0c9b-4160-a710-e071b388af42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e52643-da13-4beb-85c9-fd94d0330a8b", "tag": "4b76563d-9e42-4d52-990e-24dd9cbbde04"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:10.895826 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-30ae0961-93db-4cb3-ad49-110a2161aa49 req-6a8e1621-0c9b-4160-a710-e071b388af42 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:10.896485 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-30ae0961-93db-4cb3-ad49-110a2161aa49 req-6a8e1621-0c9b-4160-a710-e071b388af42 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:10.897090 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-30ae0961-93db-4cb3-ad49-110a2161aa49 req-6a8e1621-0c9b-4160-a710-e071b388af42 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:10.918112 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-30ae0961-93db-4cb3-ad49-110a2161aa49 req-6a8e1621-0c9b-4160-a710-e071b388af42 service nova] Creating event network-changed:4b76563d-9e42-4d52-990e-24dd9cbbde04 for instance b8e52643-da13-4beb-85c9-fd94d0330a8b on hv-cinder-86022 Oct 31 14:57:10.918647 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-30ae0961-93db-4cb3-ad49-110a2161aa49 req-6a8e1621-0c9b-4160-a710-e071b388af42 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=134339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 14:57:10.919042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-30ae0961-93db-4cb3-ad49-110a2161aa49 req-6a8e1621-0c9b-4160-a710-e071b388af42 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 14:57:10.920099 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7062b490-0664-4007-929f-c56c7e445c74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:10.920744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7062b490-0664-4007-929f-c56c7e445c74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:10.921172 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7062b490-0664-4007-929f-c56c7e445c74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:10.921919 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7062b490-0664-4007-929f-c56c7e445c74 None None] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:10.922369 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7062b490-0664-4007-929f-c56c7e445c74 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:10.922787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7062b490-0664-4007-929f-c56c7e445c74 None None] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:10.932081 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.compute.rpcapi [None req-7062b490-0664-4007-929f-c56c7e445c74 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 31 14:57:10.933191 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7062b490-0664-4007-929f-c56c7e445c74 None None] Releasing lock "compute-rpcapi-router" {{(pid=134339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 14:57:10.950841 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7062b490-0664-4007-929f-c56c7e445c74 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282889 Oct 31 14:57:10.952582 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 26/48] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:10.960045 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:10.961931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:10.969119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:10.969632 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:10.970228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:10.971470 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:10.972205 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:10.972639 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:11.048379 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:11.056404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ff8430e3-3078-48af-b2a8-1e3a15cb1d84 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1293 microversion: 2.1 time: 0.102133 Oct 31 14:57:11.057166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 27/49] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:10 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:11.062291 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:11.062909 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:11.068892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:11.069532 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:11.070128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:11.070964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:11.071423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:11.071878 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:11.079469 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:11.090184 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:11.091855 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:11.094394 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-fd7f30ef-fc5d-401f-81a6-40be22e693c6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.383075 Oct 31 14:57:11.095300 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 23/50] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:10 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:11.197979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-8ee6a740-c2a9-451a-b016-ba56af2bdec9 req-20eedb42-e424-4154-b5ed-1671309b8168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214568bd-3ebf-4f91-8153-d60959d49119", "tag": "6951bd8b-ac72-4ceb-9344-47d91749e055"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:11.210830 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-8ee6a740-c2a9-451a-b016-ba56af2bdec9 req-20eedb42-e424-4154-b5ed-1671309b8168 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:11.211809 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-8ee6a740-c2a9-451a-b016-ba56af2bdec9 req-20eedb42-e424-4154-b5ed-1671309b8168 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:11.212240 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-8ee6a740-c2a9-451a-b016-ba56af2bdec9 req-20eedb42-e424-4154-b5ed-1671309b8168 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:11.233546 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-8ee6a740-c2a9-451a-b016-ba56af2bdec9 req-20eedb42-e424-4154-b5ed-1671309b8168 service nova] Creating event network-changed:6951bd8b-ac72-4ceb-9344-47d91749e055 for instance 214568bd-3ebf-4f91-8153-d60959d49119 on hv-cinder-86022 Oct 31 14:57:11.239214 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-8ee6a740-c2a9-451a-b016-ba56af2bdec9 req-20eedb42-e424-4154-b5ed-1671309b8168 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044901 Oct 31 14:57:11.240743 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 24/51] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:11.294942 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:11.303584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-af4fb780-2e48-4238-9bf7-4dfbe6f7ee23 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.245376 Oct 31 14:57:11.304194 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 28/52] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:11 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:11.694256 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:11.695048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:11.702900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:11.703406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:11.704026 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:11.704878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:11.705534 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:11.706099 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:11.736365 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:11.737924 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:11.750093 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:11.750912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:11.751751 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:11.752646 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:11.753096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:11.753515 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:11.882901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:11.891094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8fab6041-20d4-4c3f-8503-3b32cf92f473 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.202052 Oct 31 14:57:11.891988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 25/53] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:11 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:11.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:11.930524 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-afef5cbf-4ebd-4d78-a377-a054a8a94cda tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.201281 Oct 31 14:57:11.931173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 29/54] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:11 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:12.084385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:12.085030 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:12.092941 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.093430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.093870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:12.094610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.095071 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.095540 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:12.099823 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=85 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:12.124357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:12.125161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:12.131266 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.131774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.132202 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:12.132882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.133326 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.133739 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:12.171275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:12.180135 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2f08b2a2-5aee-4f29-bafe-d1ada3a242d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1293 microversion: 2.1 time: 0.099784 Oct 31 14:57:12.196240 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 26/55] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:12 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:12.268280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:12.278845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:12.280637 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:12.281750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-145703a9-cc2e-4670-9ef8-6dc77e3ad0b0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.161390 Oct 31 14:57:12.282640 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 30/56] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:12 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:57:12.326740 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:12.327361 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:12.333333 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.334086 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.334523 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:12.335204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.335842 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.336266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:12.478912 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:12.487371 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-abac77c5-8cc8-4b02-90d9-91c244470cf3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.164472 Oct 31 14:57:12.487969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 27/57] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:12 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:12.914333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:12.914884 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:12.921934 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.922454 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.922896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:12.923825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.924380 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.924812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:12.953329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:12.954100 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:12.960187 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.960667 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.961088 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:12.962283 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:12.962912 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:12.963503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:13.062401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:13.070261 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b77b4791-413a-4624-98ef-5a82e95253f4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.159815 Oct 31 14:57:13.070821 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 31/58] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:12 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:13.108322 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:13.116562 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1097340b-0252-4b03-895b-ed99f0fe7896 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.167501 Oct 31 14:57:13.117197 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 28/59] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:12 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:13.204834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:13.206101 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:13.217560 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:13.222265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:13.224389 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:13.226445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:13.227751 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:13.228586 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:13.308217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:13.309557 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:13.318242 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:13.318945 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:13.319697 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:13.325980 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:13.326200 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:13.326955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:13.372363 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:13.387472 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e9cdbcba-8593-42c3-adb9-55db55b62182 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1293 microversion: 2.1 time: 0.186290 Oct 31 14:57:13.401026 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 32/60] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:13 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1293 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:13.513133 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:13.514136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:13.528822 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:13.531472 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:13.532583 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:13.533911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:13.534913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:13.536261 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:13.781663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:13.786948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7c9a9b38-2b16-4bc2-b03e-e709f84b6817 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.280332 Oct 31 14:57:13.796058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 33/61] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:13 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:13.868397 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:13.877309 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:13.878935 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:13.880162 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6f577012-57f1-4722-b1ac-74b91043100f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.576505 Oct 31 14:57:13.880798 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 29/62] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:13 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:57:14.094196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:14.094728 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:14.100869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.101355 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.101786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:14.102476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.102926 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.103345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:14.141157 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:14.141772 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:14.150908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.151404 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.151931 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:14.152912 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.153553 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.154179 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:14.241338 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:14.249894 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7224d8a6-9a2c-4fb1-afe9-d1c9ca30eaa0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.159812 Oct 31 14:57:14.250469 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 34/63] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:14 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:14.414955 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:14.415809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:14.422602 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.423086 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.423534 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:14.424239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.424692 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.425110 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:14.470077 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:14.477844 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c1aa33a9-b0ac-4a65-8b14-de62e4bde976 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.341234 Oct 31 14:57:14.478780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 30/64] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:14 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:14.500757 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:14.508680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-165d42ea-e1fb-4992-9ac3-1002edde6fd6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1301 microversion: 2.1 time: 0.097657 Oct 31 14:57:14.509326 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 35/65] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:14 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:14.810927 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:14.811781 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:14.818233 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.818952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.819428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:14.820187 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.820646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.821068 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:14.907086 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:14.907857 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:14.913891 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.914365 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.914792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:14.915477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:14.916077 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:14.916496 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:15.060872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:15.070286 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:15.072192 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:15.073726 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2b287f58-7c36-47e9-a308-636d695b3db8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.170850 Oct 31 14:57:15.074437 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 36/66] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:14 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:57:15.110215 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-4ee1473e-8c7b-4c9f-a63d-8affd706dce0 req-13c7db4b-5370-4b5b-93a5-5683b14ff863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820c59dc-ee1a-4470-b9d6-14060ebd8337", "tag": "24a2724b-5bec-4b7b-938e-508059f058d4"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:15.119636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-4ee1473e-8c7b-4c9f-a63d-8affd706dce0 req-13c7db4b-5370-4b5b-93a5-5683b14ff863 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:15.120186 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-4ee1473e-8c7b-4c9f-a63d-8affd706dce0 req-13c7db4b-5370-4b5b-93a5-5683b14ff863 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:15.120753 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-4ee1473e-8c7b-4c9f-a63d-8affd706dce0 req-13c7db4b-5370-4b5b-93a5-5683b14ff863 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:15.127055 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:15.132844 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-4ee1473e-8c7b-4c9f-a63d-8affd706dce0 req-13c7db4b-5370-4b5b-93a5-5683b14ff863 service nova] Creating event network-changed:24a2724b-5bec-4b7b-938e-508059f058d4 for instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 on hv-cinder-86022 Oct 31 14:57:15.135523 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-283c0194-5b10-4a60-b469-3a34a805083f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.329307 Oct 31 14:57:15.138878 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-4ee1473e-8c7b-4c9f-a63d-8affd706dce0 req-13c7db4b-5370-4b5b-93a5-5683b14ff863 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032245 Oct 31 14:57:15.139466 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 37/67] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:57:15.151853 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 31/68] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:14 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:15.278816 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:15.279541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:15.286153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:15.286683 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:15.287066 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:15.287806 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:15.288261 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:15.288684 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:15.434220 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:15.442035 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4960cbad-70de-4ce6-8ded-70390a7857ae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.169551 Oct 31 14:57:15.442590 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 38/69] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:15 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:15.502740 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:15.503376 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:15.509452 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:15.509970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:15.510400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:15.511109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:15.511570 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:15.512002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:15.532769 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:15.533633 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:15.539905 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:15.540392 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:15.540825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:15.541520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:15.541971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:15.542966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:15.559671 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:15.609191 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:15.616845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-20798c1c-36d2-4e2c-acef-7a1b718c6485 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1301 microversion: 2.1 time: 0.088177 Oct 31 14:57:15.617411 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 39/70] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:15 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:15.647334 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:15.655672 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7a70bad2-3a93-423c-be18-48b551b9fcff tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.156833 Oct 31 14:57:15.656228 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 32/71] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:15 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:16.101996 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:16.102831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:16.110692 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.111270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.111632 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.112308 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.112753 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.113171 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.161003 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:16.161740 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:16.168147 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.168634 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.169067 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.169813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.170302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.170722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.243155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:16.252418 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:16.253581 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:16.254886 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f71446bf-c5d1-45d0-b6c6-0cdd9e0bd280 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.158057 Oct 31 14:57:16.255918 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 40/72] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:16 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:16.314130 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:16.323313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b04c1614-e7e8-47fe-aa88-cd336e958921 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.166233 Oct 31 14:57:16.324627 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 33/73] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:16 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:16.465452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:16.466092 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:16.472055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.472548 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.472983 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.473675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.474125 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.474546 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.612034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:16.620094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a2d9e9b4-a0a3-4824-868a-053b379888b6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.158453 Oct 31 14:57:16.621317 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 41/74] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:16 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:16.639606 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:16.640230 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:16.646335 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.646813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.647245 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.647959 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.648413 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.648834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.678233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:16.678771 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:16.685448 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.685926 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.686357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.687042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:16.687519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:16.688150 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:16.710640 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:16.718785 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4dc0c82b-5d4f-4b83-8d11-050e1ed19d56 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1301 microversion: 2.1 time: 0.083246 Oct 31 14:57:16.723598 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 34/75] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:16 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:16.838383 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:16.846947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-dde1beb1-c9d9-4faf-9604-271ae7c3843a tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.172590 Oct 31 14:57:16.847714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 42/76] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:16 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:17.288210 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:17.289952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:17.307698 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.308446 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.308933 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.310702 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.311220 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.311680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.343585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-09ba8278-98de-43e2-976c-299f06bd5392 req-b2cc530d-2939-42e1-a109-976aa46e9ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e71890-419f-41a8-8e60-cd53d110c7ba", "tag": "6bb7edab-168d-4a77-a2bd-14d7c9e243e8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:17.360536 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-09ba8278-98de-43e2-976c-299f06bd5392 req-b2cc530d-2939-42e1-a109-976aa46e9ea1 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.361112 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-09ba8278-98de-43e2-976c-299f06bd5392 req-b2cc530d-2939-42e1-a109-976aa46e9ea1 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.361548 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-09ba8278-98de-43e2-976c-299f06bd5392 req-b2cc530d-2939-42e1-a109-976aa46e9ea1 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.386956 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-09ba8278-98de-43e2-976c-299f06bd5392 req-b2cc530d-2939-42e1-a109-976aa46e9ea1 service nova] Creating event network-changed:6bb7edab-168d-4a77-a2bd-14d7c9e243e8 for instance c9e71890-419f-41a8-8e60-cd53d110c7ba on hv-cinder-86022 Oct 31 14:57:17.392840 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-09ba8278-98de-43e2-976c-299f06bd5392 req-b2cc530d-2939-42e1-a109-976aa46e9ea1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054746 Oct 31 14:57:17.393891 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 43/77] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:57:17.400035 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:17.400756 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:17.408594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.409081 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.410187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.410911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.411367 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.411820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.687729 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:17.695541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b7358345-c198-482d-bd3c-de19e3c08c11 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.300297 Oct 31 14:57:17.696149 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 44/78] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:17 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:17.705704 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:17.706548 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:17.713085 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.715401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.715879 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.716588 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.717050 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.717473 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.738901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:17.747610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:17.749056 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:17.750162 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ebf0427e-090b-4b14-8e93-36c4c1c608c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.469867 Oct 31 14:57:17.750720 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 35/79] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:17 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:17.755387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:17.756031 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:17.762625 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.763106 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.763815 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.764510 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.765118 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.765700 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.827988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:17.836017 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-024cf079-7015-45c4-b201-61df4ebdcc8d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1299 microversion: 2.1 time: 0.084015 Oct 31 14:57:17.836589 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 36/80] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:17 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:17.853492 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:17.861721 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e20ce0fd-6a33-4994-8a2a-a97bf8d96128 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.159700 Oct 31 14:57:17.862335 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 45/81] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:17 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:17.874724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:17.875330 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:17.881280 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.881754 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.882178 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:17.882852 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:17.883296 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:17.883741 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:18.008636 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:18.016649 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5d9463f8-c667-4ad4-968d-36c14b0f3983 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.146255 Oct 31 14:57:18.017210 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 37/82] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:17 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:18.718073 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:18.718678 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:18.724567 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:18.725040 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:18.725472 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:18.726147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:18.726612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:18.727051 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:18.775502 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:18.776132 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:18.777974 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=8 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:18.778674 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=32 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:18.784602 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:18.785012 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:18.785436 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:18.786131 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:18.786573 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:18.786986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:18.855643 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:18.863218 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e7b65546-10af-4868-9940-b6d5b0222035 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.148875 Oct 31 14:57:18.864051 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 46/83] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:18 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:18.868474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:18.869072 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:18.875905 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:18.876388 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:18.876817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:18.877509 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:18.877961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:18.878368 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:18.920481 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:18.928559 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:18.930002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:18.931113 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-eb13d2e2-9140-4e81-91d7-d8850d740ef6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.159447 Oct 31 14:57:18.931685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 38/84] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:18 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:57:18.936780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:18.937387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:18.939073 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:18.943117 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:18.943616 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:18.944313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:18.945001 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:18.945449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:18.945869 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:18.949019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0b476d8d-1ca6-44d6-8592-10651bfaa5e7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1299 microversion: 2.1 time: 0.083856 Oct 31 14:57:18.949714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 47/85] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:18 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:19.039345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:19.040161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:19.047080 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:19.047592 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:19.048203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:19.048886 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:19.049473 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:19.050068 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:19.084878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:19.093610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-56c2d593-abee-4efd-976d-040853b689c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.160674 Oct 31 14:57:19.094745 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 39/86] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:18 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:19.178714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:19.197394 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:19.208116 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-df578f1c-9aef-4c0d-b8fa-2f48d5c023b3 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.172660 Oct 31 14:57:19.209121 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 48/87] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:19 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:19.397401 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-9147ccf6-db32-4d5e-ae70-b3bf84baa481 req-6429a6ef-f9d8-4a39-894c-bf14e4f94d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c93f4d-15ed-4113-95ad-b6766332779e", "name": "network-vif-plugged", "status": "completed", "tag": "3f33f9e8-094c-4cdc-84e0-fcaac96a6b7a"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:19.407262 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-9147ccf6-db32-4d5e-ae70-b3bf84baa481 req-6429a6ef-f9d8-4a39-894c-bf14e4f94d01 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:19.407778 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-9147ccf6-db32-4d5e-ae70-b3bf84baa481 req-6429a6ef-f9d8-4a39-894c-bf14e4f94d01 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:19.408206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-9147ccf6-db32-4d5e-ae70-b3bf84baa481 req-6429a6ef-f9d8-4a39-894c-bf14e4f94d01 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:19.419484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-9147ccf6-db32-4d5e-ae70-b3bf84baa481 req-6429a6ef-f9d8-4a39-894c-bf14e4f94d01 service nova] Creating event network-vif-plugged:3f33f9e8-094c-4cdc-84e0-fcaac96a6b7a for instance f1c93f4d-15ed-4113-95ad-b6766332779e on hv-cinder-86022 Oct 31 14:57:19.424380 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-9147ccf6-db32-4d5e-ae70-b3bf84baa481 req-6429a6ef-f9d8-4a39-894c-bf14e4f94d01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083829 Oct 31 14:57:19.424946 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 40/88] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:19.886651 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:19.887280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:19.893475 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:19.893953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:19.894377 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:19.895056 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:19.895503 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:19.895946 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:19.959875 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:19.960950 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:19.969709 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:19.970859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:19.971476 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:19.972396 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:19.973020 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:19.973614 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:20.432316 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:20.466804 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-fe8eaf48-edfd-4c77-b648-2b61c9609b67 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.572232 Oct 31 14:57:20.470224 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 49/89] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:19 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:20.478948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:20.481085 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:20.493359 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:20.494827 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:20.501111 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:20.504196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:20.505671 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:20.506702 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:20.615288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:20.636829 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:20.641743 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:20.646444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0acb334b-00d8-4b2d-b845-3da1850235dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.692944 Oct 31 14:57:20.650325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 41/90] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:19 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:20.666199 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:20.668005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:20.677175 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:20.677868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:20.678494 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:20.679368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:20.680062 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:20.680710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:20.778965 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:20.787338 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b29961ac-0360-454c-9aa6-53f943babf16 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1299 microversion: 2.1 time: 0.315622 Oct 31 14:57:20.787957 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 50/91] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:20 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1299 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:20.797278 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:20.798038 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:20.807422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:20.808814 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:20.809555 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:20.810327 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:20.810847 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:20.811512 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:20.931507 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=6 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:20.994681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:21.005739 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0ebe668f-5982-4416-9318-2f8bdc2eadd6 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.213794 Oct 31 14:57:21.008648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 51/92] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:20 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:21.147178 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:21.155440 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-32d8a156-76f5-4e1a-9b8e-5689c606f2b8 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.503882 Oct 31 14:57:21.156283 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 42/93] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:20 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:21.495587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:21.499333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:21.508037 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:21.508771 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:21.509431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:21.510220 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:21.510740 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:21.511220 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:21.664146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:21.674228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-37f392a7-e783-4f3e-b0d3-3083f39678da tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.182362 Oct 31 14:57:21.674812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 52/94] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:21 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:21.677544 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:21.678213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:21.686127 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:21.686609 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:21.687041 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:21.687775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:21.688228 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:21.688646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:21.706146 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=100 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:21.813208 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:21.813819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:21.819851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:21.820325 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:21.820755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:21.821569 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:21.822021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:21.822438 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:21.830862 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:21.839468 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:21.840942 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:21.842094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9d194e20-45be-4159-8cc1-db8d08d604d9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.169566 Oct 31 14:57:21.842652 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 43/95] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:21 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:57:21.954668 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:21.962790 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-37d10faf-8b79-4893-bd7a-0ad0af612926 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.153795 Oct 31 14:57:21.963361 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 53/96] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:21 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:22.031006 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:22.031545 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:22.037504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.037983 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.038414 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:22.039097 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.039566 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.039990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:22.166437 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:22.174684 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-85840944-132f-475f-ba5b-ab48fb6c9075 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.147517 Oct 31 14:57:22.175540 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 44/97] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:22 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:22.180184 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:22.180791 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:22.187689 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.188160 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.188583 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:22.189255 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.189693 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.190105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:22.315363 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:22.323047 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-359a8985-7b0b-44df-9100-3fe67e277ee2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.146560 Oct 31 14:57:22.323634 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 54/98] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:22 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:22.697689 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:22.698777 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:22.704705 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.705183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.705606 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:22.706279 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.706722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.707133 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:22.840539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:22.848180 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9d9e54f7-5bc3-44f9-8536-7c5bf7b39f95 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.154243 Oct 31 14:57:22.848741 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 45/99] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:22 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:22.867570 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:22.868203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:22.874360 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.874837 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.875268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:22.876202 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.876602 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.877025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:22.985327 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:22.986060 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:22.992035 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.992514 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.992937 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:22.993612 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:22.994053 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:22.994466 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:23.002387 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:23.010263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:23.012413 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:23.013505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2bd042d0-1bcc-4b2c-a660-38e86f53a10b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.150069 Oct 31 14:57:23.014053 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 55/100] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:22 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:23.120817 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:23.128425 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5eed92bb-9d51-4bff-8d2c-db9274897c6c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.146979 Oct 31 14:57:23.128990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 46/101] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:22 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:23.198702 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:23.199815 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:23.205786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:23.206263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:23.206929 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:23.207634 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:23.208458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:23.208878 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:23.345364 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:23.345901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:23.346533 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:23.348444 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:23.354044 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:23.355744 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:23.356695 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:23.357615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:23.358227 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:23.358567 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-06a33f37-d92d-4d1d-9cb8-72d74f1533f0 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.164423 Oct 31 14:57:23.358805 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:23.359155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 56/102] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:23 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:23.495912 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:23.505180 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-da088320-6185-4c89-bc05-7bfdc76b291f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.162964 Oct 31 14:57:23.505757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 47/103] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:23 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:23.870687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:23.871325 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:23.877691 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:23.878171 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:23.878597 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:23.879277 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:23.879757 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:23.880171 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:23.920188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-0e6c3330-ae3b-43cf-b889-8cc5e62e2629 req-72d1bff9-4aad-42d8-bc77-b83707e67568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e52643-da13-4beb-85c9-fd94d0330a8b", "name": "network-vif-plugged", "status": "completed", "tag": "4b76563d-9e42-4d52-990e-24dd9cbbde04"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:23.939336 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-0e6c3330-ae3b-43cf-b889-8cc5e62e2629 req-72d1bff9-4aad-42d8-bc77-b83707e67568 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:23.940385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-0e6c3330-ae3b-43cf-b889-8cc5e62e2629 req-72d1bff9-4aad-42d8-bc77-b83707e67568 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:23.941347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-0e6c3330-ae3b-43cf-b889-8cc5e62e2629 req-72d1bff9-4aad-42d8-bc77-b83707e67568 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:23.963393 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-0e6c3330-ae3b-43cf-b889-8cc5e62e2629 req-72d1bff9-4aad-42d8-bc77-b83707e67568 service nova] Creating event network-vif-plugged:4b76563d-9e42-4d52-990e-24dd9cbbde04 for instance b8e52643-da13-4beb-85c9-fd94d0330a8b on hv-cinder-86022 Oct 31 14:57:23.969539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-0e6c3330-ae3b-43cf-b889-8cc5e62e2629 req-72d1bff9-4aad-42d8-bc77-b83707e67568 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053478 Oct 31 14:57:23.970823 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 48/104] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:57:24.052076 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:24.053348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:24.063656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:24.064159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:24.064834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:24.065761 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:24.066407 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:24.066926 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:24.072895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:24.081845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1acd6b30-b16d-4cdd-8053-267a0b0ac0ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.215070 Oct 31 14:57:24.082559 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 57/105] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:23 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:24.156201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:24.157463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:24.166653 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:24.167310 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:24.168002 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:24.169622 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:24.170472 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:24.171235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:24.486995 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:24.499947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:24.503046 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:24.506121 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:24.508025 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-11f7b674-b290-4ea0-b98c-925d51b98c35 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.468313 Oct 31 14:57:24.508933 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-dbee5186-a500-40d4-bbe0-65e24e9c72e5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.358792 Oct 31 14:57:24.509722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 49/106] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:24 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:57:24.523393 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:24.523856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 58/107] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:24 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:24.523965 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:24.537045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:24.537656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:24.538161 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:24.538932 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:24.539454 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:24.539969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:24.544975 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:24.545593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:24.553690 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:24.554178 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:24.554606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:24.555922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:24.556672 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:24.557121 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:24.768207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:24.782667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-91679456-09ea-4762-9a88-85cae2d3ebb2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.245034 Oct 31 14:57:24.797078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 59/108] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:24 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:25.088398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:25.098845 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7cd820c3-5d69-4533-828d-2c0756a4656b tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.587822 Oct 31 14:57:25.109414 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 50/109] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:24 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:25.110459 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:25.111076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:25.117775 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:25.119272 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:25.122749 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:25.123583 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:25.124112 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:25.124624 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:25.383455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:25.404535 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-557a7200-b036-47f9-8217-fed70b175c21 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.297834 Oct 31 14:57:25.422470 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 60/110] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:25 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:25.533916 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:25.534639 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:25.540629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:25.541108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:25.541531 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:25.543393 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:25.543882 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:25.544160 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:25.544569 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:25.544782 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:25.552722 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:25.553504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:25.554063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:25.555002 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:25.555450 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:25.555898 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:25.695440 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:25.705372 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:25.707287 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:25.708869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3300c6c3-a357-4dbb-869d-10540f36842f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.170360 Oct 31 14:57:25.709808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 61/111] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:25 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:25.784774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-a450be2c-307a-4a57-b3de-77358a1b7a8e req-43627e4d-7873-4d87-8cf1-20a29334f72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90f3404c-864a-4f8c-9444-8b3740b79f7b", "tag": "066e375b-5369-47d6-9723-3f3d6ad24590"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:25.789955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:25.795484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-a450be2c-307a-4a57-b3de-77358a1b7a8e req-43627e4d-7873-4d87-8cf1-20a29334f72c service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:25.796148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-a450be2c-307a-4a57-b3de-77358a1b7a8e req-43627e4d-7873-4d87-8cf1-20a29334f72c service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:25.796814 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-a450be2c-307a-4a57-b3de-77358a1b7a8e req-43627e4d-7873-4d87-8cf1-20a29334f72c service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:25.798139 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6d2f9eee-6ac1-46a3-82e4-4ef75a27f0d1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.268266 Oct 31 14:57:25.798712 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 51/112] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:25 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:25.813784 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:25.814450 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:25.823423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-a450be2c-307a-4a57-b3de-77358a1b7a8e req-43627e4d-7873-4d87-8cf1-20a29334f72c service nova] Creating event network-changed:066e375b-5369-47d6-9723-3f3d6ad24590 for instance 90f3404c-864a-4f8c-9444-8b3740b79f7b on hv-cinder-86022 Oct 31 14:57:25.826654 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:25.827414 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:25.827966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:25.828727 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:25.828850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-a450be2c-307a-4a57-b3de-77358a1b7a8e req-43627e4d-7873-4d87-8cf1-20a29334f72c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047950 Oct 31 14:57:25.829323 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:25.829746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:25.829922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 62/113] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:57:25.967884 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:25.975534 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6b5abc39-717c-4613-86ec-c39fb918907f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.169329 Oct 31 14:57:25.976420 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 52/114] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:25 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:26.123985 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:26.124892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:26.131011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:26.131496 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:26.131961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:26.132650 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:26.133102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:26.133526 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:26.334710 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:26.350130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d07e7f67-45d2-4cf6-b8b2-fcd581db6975 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.231257 Oct 31 14:57:26.350705 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 63/115] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:26 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:26.428990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:26.429595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:26.436300 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:26.436774 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:26.437200 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:26.438049 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:26.438496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:26.438906 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:26.573571 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:26.581364 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-46efe8cc-ddae-4273-a825-9ef676cbb858 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.157309 Oct 31 14:57:26.581940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 53/116] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:26 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:26.734887 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:26.735732 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:26.742277 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:26.742898 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:26.743457 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:26.744274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:26.745318 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:26.745730 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:26.821576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:26.822187 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:26.828505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:26.828989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:26.829416 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:26.830105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:26.830548 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:26.831157 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:26.977936 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:26.986998 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:26.996760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:26.997304 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-bd627bd7-96be-47e4-b347-24c05ebad187 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.179638 Oct 31 14:57:26.998624 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 54/117] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:26 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:26.998785 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:27.000147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-100002da-c64f-47d9-82df-133bf01c9d5e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.269281 Oct 31 14:57:27.000859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 64/118] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:26 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:27.003948 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:27.004656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:27.011401 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:27.012700 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:27.013347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:27.014705 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:27.015233 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:27.015793 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:27.183409 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:27.191775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-252b5adb-e043-489c-bebf-29aa57c7cf1f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.191807 Oct 31 14:57:27.192416 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 55/119] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:26 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:27.376592 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:27.377213 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:27.383084 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:27.383586 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:27.384033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:27.384847 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:27.385795 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:27.386278 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:27.534845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:27.543828 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-018305b2-10b1-4557-b5ff-507753797e31 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.171261 Oct 31 14:57:27.544398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 65/120] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:27 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:27.604139 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:27.604844 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:27.610820 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:27.611511 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:27.611976 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:27.612661 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:27.613114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:27.613535 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:27.750249 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:27.758266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-915a98f9-7ebf-4279-99a8-3847673b2470 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.157846 Oct 31 14:57:27.758794 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 56/121] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:27 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:28.021354 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:28.022276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:28.028191 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:28.028807 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:28.030068 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.031649 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.032489 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.033538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.034411 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.035027 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.036713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.037356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.037794 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.039300 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.039779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.040201 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.235632 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:28.247452 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:28.248042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:28.249024 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:28.255930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-89785f2d-ed4c-4b12-9db7-1f0d8b50d441 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.233546 Oct 31 14:57:28.273315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 57/122] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:28 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:28.273315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:28.273315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:28.273315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.273315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.273853 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.273853 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.273853 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.273853 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.280413 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7c1fbc7e-7ac5-46ac-afcb-a94ebc48d6b2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.263015 Oct 31 14:57:28.295527 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 66/123] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:28 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:28.430584 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:28.440788 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0f05e2c6-aa71-41e3-ad65-7d4fdb9e34c9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.182860 Oct 31 14:57:28.441810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 58/124] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:28 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:28.566961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:28.567786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:28.579540 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.580641 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.581605 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.582393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.583489 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.584541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.781811 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:28.782980 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:28.783347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:28.789854 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.790694 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.791401 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.793032 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:28.794221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:28.794746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:28.797642 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-54ee2b7b-c09c-4348-8594-fada73dccf32 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1315 microversion: 2.1 time: 0.234902 Oct 31 14:57:28.813767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 67/125] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:28 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:28.946549 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:28.954235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c29ef5c0-2319-400e-8224-485961a2df1d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.176328 Oct 31 14:57:28.954789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 59/126] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:28 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:29.290438 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:29.290859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:29.297900 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.298477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.298808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:29.299532 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.306030 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:29.306638 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:29.312296 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.312776 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:29.313394 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.313951 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.314462 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:29.315350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.316001 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.316571 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:29.446542 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:29.446673 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:29.449571 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=100 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:29.456119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:29.456278 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-04d0b346-c69f-4211-b9bc-f637a914e91d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.153958 Oct 31 14:57:29.456743 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 60/127] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:29 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:29.459612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:29.460783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cab39ecf-7e1d-42b6-994e-98d3411c1dab tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.174464 Oct 31 14:57:29.461477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 68/128] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:29 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:29.464474 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:29.465071 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:29.470919 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.471443 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.471922 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:29.472595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.473035 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.473444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:29.604517 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:29.614188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-56f5e076-043d-4b93-94f1-038bebfca89b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.153773 Oct 31 14:57:29.614785 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 61/129] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:29 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:29.821049 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:29.821577 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:29.828767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.829285 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.830117 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:29.830860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.831671 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.832090 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:29.964554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:29.972212 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ad2c04aa-b65d-49dd-ab86-c64f3819420c tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1502 microversion: 2.1 time: 0.154962 Oct 31 14:57:29.972773 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 69/130] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:29 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:29.978325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:29.979031 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:29.985304 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.985779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.986475 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:29.987430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:29.988271 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:29.988371 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:30.119484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:30.128136 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ee4e7eaf-d8c9-42bb-bfc5-6789d31af413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.153879 Oct 31 14:57:30.128744 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 62/131] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:29 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:30.480556 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:30.481238 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:30.483198 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:30.486250 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:30.486853 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:30.488184 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:30.488657 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:30.489086 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:30.489769 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:30.490214 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:30.490627 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:30.492552 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:30.493022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:30.493452 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:30.494130 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:30.495156 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:30.495604 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:30.624480 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:30.625885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:30.632980 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b2c7ce5b-3269-4ba9-b77f-9c056a52522b tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.156630 Oct 31 14:57:30.633633 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 70/132] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:30 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:30.634007 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:30.635973 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:30.637093 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6f8e1dc1-15b2-44fe-bef6-39860a3a35a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.155026 Oct 31 14:57:30.637632 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 63/133] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:30 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:30.643419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:30.644072 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:30.650157 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:30.650628 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:30.651708 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:30.652411 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:30.652884 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:30.653299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:30.777394 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:30.784954 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3f65d7df-7ee7-46bc-9d70-40cae2983e7f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.150158 Oct 31 14:57:30.785543 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 71/134] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:30 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:31.154765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:31.155404 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:31.161430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:31.161904 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:31.162331 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:31.163018 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:31.163456 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:31.163907 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:31.290918 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:31.298569 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-01f93eb4-b78c-4e67-ae96-a0bbf250dee2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.148272 Oct 31 14:57:31.299125 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 64/135] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:31 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:31.655963 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:31.656579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:31.661619 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:31.662445 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:31.663136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:31.663664 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:31.664114 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:31.664815 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:31.665293 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:31.665717 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:31.669069 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:31.669548 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:31.669979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:31.670658 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:31.671106 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:31.671520 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:31.801955 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:31.813609 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:31.816191 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-88c2c13d-318d-4117-829e-57c1965dc8d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.164018 Oct 31 14:57:31.816779 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 72/136] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:31 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:31.821151 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:31.821756 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:31.834770 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:31.836858 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:31.837991 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8b16da2a-4742-4738-9aab-8f231a4a527b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.180169 Oct 31 14:57:31.839310 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 65/137] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:31 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:31.843277 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:31.847902 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:31.848439 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:31.849279 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:31.850019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:31.852578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:32.038618 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:32.049121 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3ab116e0-58c1-4a12-b660-b9e9a4bd96a6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.231296 Oct 31 14:57:32.049555 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-11e0fd67-15ac-4ebc-9d33-73f9ab0c9d9e req-339512d0-eb86-4d07-9107-31bbfcd73003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e71890-419f-41a8-8e60-cd53d110c7ba", "name": "network-vif-plugged", "status": "completed", "tag": "6bb7edab-168d-4a77-a2bd-14d7c9e243e8"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:32.051016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 73/138] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:31 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:32.058460 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:32.062672 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-11e0fd67-15ac-4ebc-9d33-73f9ab0c9d9e req-339512d0-eb86-4d07-9107-31bbfcd73003 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:32.063301 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-11e0fd67-15ac-4ebc-9d33-73f9ab0c9d9e req-339512d0-eb86-4d07-9107-31bbfcd73003 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:32.063955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-11e0fd67-15ac-4ebc-9d33-73f9ab0c9d9e req-339512d0-eb86-4d07-9107-31bbfcd73003 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:32.090758 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-11e0fd67-15ac-4ebc-9d33-73f9ab0c9d9e req-339512d0-eb86-4d07-9107-31bbfcd73003 service nova] Creating event network-vif-plugged:6bb7edab-168d-4a77-a2bd-14d7c9e243e8 for instance c9e71890-419f-41a8-8e60-cd53d110c7ba on hv-cinder-86022 Oct 31 14:57:32.096291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-11e0fd67-15ac-4ebc-9d33-73f9ab0c9d9e req-339512d0-eb86-4d07-9107-31bbfcd73003 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051286 Oct 31 14:57:32.096928 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 66/139] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:57:32.324342 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:32.325401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:32.349963 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:32.350720 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:32.351503 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:32.352377 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:32.352967 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:32.353548 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:32.360714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:32.438904 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9de445a1-9c95-4d64-9b1b-208c208d3506 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41bf7644-f68f-4e34-97cc-9eec01836a0a"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:32.441546 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9de445a1-9c95-4d64-9b1b-208c208d3506 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:32.460036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9de445a1-9c95-4d64-9b1b-208c208d3506 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:32.460925 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9de445a1-9c95-4d64-9b1b-208c208d3506 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:32.461567 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9de445a1-9c95-4d64-9b1b-208c208d3506 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:32.462330 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9de445a1-9c95-4d64-9b1b-208c208d3506 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:32.462781 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9de445a1-9c95-4d64-9b1b-208c208d3506 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:32.464043 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9de445a1-9c95-4d64-9b1b-208c208d3506 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:32.554139 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:32.565323 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-23f85304-df88-4a5d-8eb8-fab0848b9930 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.247152 Oct 31 14:57:32.565866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 74/140] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:32 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:32.839864 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:32.840489 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:32.846331 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:32.846803 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:32.847229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:32.847928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:32.848371 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:32.848784 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:32.976136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:32.984033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-77bd49f3-c87a-4a3f-8142-479415473a22 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.148414 Oct 31 14:57:32.984590 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 75/141] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:32 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:32.988885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:32.989474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:32.995688 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:32.996159 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:32.996581 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:32.997248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:32.997686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:32.998102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:33.122196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:33.130612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:33.132069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:33.133163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-12101b45-4420-4239-87a3-3b76f3ce20e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.147681 Oct 31 14:57:33.133703 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 76/142] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:32 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:33.139811 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:33.140425 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:33.146400 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:33.146883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:33.147314 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:33.148026 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:33.148476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:33.148892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:33.292324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:33.302706 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cd59467c-6417-48f0-9937-ff757b996b57 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.167807 Oct 31 14:57:33.303295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 77/143] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:33 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:33.589834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:33.590370 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:33.596328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:33.596791 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:33.597221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:33.597899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:33.598347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:33.598766 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:33.733920 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:33.745475 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3369612b-0ae6-4347-95e0-51477c2d3370 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.160104 Oct 31 14:57:33.759572 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 78/144] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:33 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:34.006379 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:34.007726 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:34.014589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:34.015076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:34.015498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:34.016520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:34.017028 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:34.017747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:34.149781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:34.158122 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-76ffd035-6911-4e39-9f6f-90ba2ca39cb1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.155572 Oct 31 14:57:34.158688 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 79/145] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:34 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:34.163083 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:34.163899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:34.170240 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:34.170790 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:34.171252 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:34.171993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:34.172447 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:34.172865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:34.312857 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:34.321163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:34.323011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:34.324473 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-355a4f32-bdb6-4049-bc3d-ebe08af9ca56 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.164871 Oct 31 14:57:34.325033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 80/146] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:34 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:34.329515 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:34.330236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:34.336380 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:34.336916 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:34.337353 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:34.338565 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:34.339016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:34.339436 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:34.477481 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:34.486912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-10b41d66-e0cb-4e22-8884-0afb91bc81ad tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.160902 Oct 31 14:57:34.487487 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 81/147] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:34 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:34.768250 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:34.768864 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:34.775260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:34.776406 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:34.777396 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:34.778163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:34.778616 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:34.779463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:34.914471 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:34.923249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4e6490da-b568-43ef-86e8-b0d6a4e87d35 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.158691 Oct 31 14:57:34.924145 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 82/148] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:34 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:35.182995 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:35.183662 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:35.189860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:35.190334 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:35.190787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:35.191488 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:35.191951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:35.192363 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:35.324915 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:35.333136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1e05da31-5de6-4ee4-97a4-501affb4d52d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.154631 Oct 31 14:57:35.333901 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 83/149] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:35 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:35.349631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:35.350235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:35.357051 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:35.357531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:35.357959 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:35.358641 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:35.359104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:35.359511 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:35.491482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:35.501891 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:35.503317 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:35.504669 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7bffbd39-aecf-4b29-890f-1e67252f206d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.158787 Oct 31 14:57:35.505220 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 84/150] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:35 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:57:35.509713 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:35.510586 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:35.516563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:35.517028 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:35.517621 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:35.518818 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:35.519478 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:35.520131 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:35.671188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:35.682489 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d6530f73-9cfc-4082-b819-78b732562247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.175483 Oct 31 14:57:35.683641 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 85/151] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:35 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:35.700446 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-56256979-8c1b-4739-aa06-0357c80af19e req-f2db9770-6caa-46d3-986e-ebe1776f9d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214568bd-3ebf-4f91-8153-d60959d49119", "name": "network-vif-plugged", "status": "completed", "tag": "6951bd8b-ac72-4ceb-9344-47d91749e055"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:35.723115 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-56256979-8c1b-4739-aa06-0357c80af19e req-f2db9770-6caa-46d3-986e-ebe1776f9d5f service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:35.723776 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-56256979-8c1b-4739-aa06-0357c80af19e req-f2db9770-6caa-46d3-986e-ebe1776f9d5f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:35.724253 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-56256979-8c1b-4739-aa06-0357c80af19e req-f2db9770-6caa-46d3-986e-ebe1776f9d5f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:35.737462 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-56256979-8c1b-4739-aa06-0357c80af19e req-f2db9770-6caa-46d3-986e-ebe1776f9d5f service nova] Creating event network-vif-plugged:6951bd8b-ac72-4ceb-9344-47d91749e055 for instance 214568bd-3ebf-4f91-8153-d60959d49119 on hv-cinder-86022 Oct 31 14:57:35.743088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-56256979-8c1b-4739-aa06-0357c80af19e req-f2db9770-6caa-46d3-986e-ebe1776f9d5f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048017 Oct 31 14:57:35.743858 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 86/152] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:35.948028 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:35.949615 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:35.958913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:35.967214 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:35.968311 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:35.969347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:35.971274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:35.972187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:36.206434 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9de445a1-9c95-4d64-9b1b-208c208d3506 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "POST /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.768533 Oct 31 14:57:36.207033 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 67/153] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 14:57:32 2022] POST /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e/os-volume_attachments => generated 194 bytes in 3773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:57:36.247093 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:36.260231 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-695219eb-5b71-42d6-bd41-2afbf0fdcbc4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.317504 Oct 31 14:57:36.262854 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 87/154] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:35 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:36.358793 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:36.359492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:36.367898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:36.368386 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:36.368822 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:36.370080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:36.370542 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:36.370970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:36.532711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:36.533406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:36.534463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:36.542225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-53473ef3-69b2-49ff-b9aa-8218bba668b9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.188809 Oct 31 14:57:36.542531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:36.542799 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 68/155] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:36 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:36.543153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:36.543986 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:36.545012 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:36.545656 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:36.546086 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:36.706069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:36.708279 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:36.708988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:36.716171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:36.716504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:36.716717 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:36.717420 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:36.718227 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:36.718911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:36.719405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:36.719516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:36.720996 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7a430e57-8b4e-4950-bdf2-5a513ff08fa1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.192441 Oct 31 14:57:36.721564 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 88/156] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:36 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:37.044326 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:37.055030 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-62e41e39-5031-4f57-9518-03ce40eaacf2 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.351020 Oct 31 14:57:37.055898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 69/157] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:36 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:37.287995 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:37.288609 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:37.296421 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:37.296964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:37.297370 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:37.298057 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:37.298486 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:37.298970 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:37.469247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:37.477566 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1f4c3b50-60a1-4bf5-a344-769da20a7656 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1320 microversion: 2.1 time: 0.195810 Oct 31 14:57:37.478132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 89/158] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:37 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:37.567204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:37.568082 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:37.574909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:37.575453 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:37.575970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:37.576734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:37.577254 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:37.577740 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:37.721866 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:37.731193 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-63a24be2-d615-4da0-b4ae-aae51fe11a06 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.168405 Oct 31 14:57:37.731897 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 70/159] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:37 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:37.752719 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:37.753681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:37.766365 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:37.767000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:37.767833 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:37.768607 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:37.769188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:37.769688 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:37.924045 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:37.939238 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:37.941328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:37.943328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c83d8096-3026-4fea-b196-fc8269546f61 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.194925 Oct 31 14:57:37.944756 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 90/160] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:37 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:38.062138 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-795a3c6e-2a89-42e8-97ef-d48f0f0982c5 req-2c25b1c2-ba50-4810-879d-6bc8e20fbd4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820c59dc-ee1a-4470-b9d6-14060ebd8337", "name": "network-vif-plugged", "status": "completed", "tag": "24a2724b-5bec-4b7b-938e-508059f058d4"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:38.073898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-795a3c6e-2a89-42e8-97ef-d48f0f0982c5 req-2c25b1c2-ba50-4810-879d-6bc8e20fbd4f service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.079500 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:38.080310 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:38.087313 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.087972 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.088402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.088819 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-795a3c6e-2a89-42e8-97ef-d48f0f0982c5 req-2c25b1c2-ba50-4810-879d-6bc8e20fbd4f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.089452 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-795a3c6e-2a89-42e8-97ef-d48f0f0982c5 req-2c25b1c2-ba50-4810-879d-6bc8e20fbd4f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.094563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.095036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.095461 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.109418 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-795a3c6e-2a89-42e8-97ef-d48f0f0982c5 req-2c25b1c2-ba50-4810-879d-6bc8e20fbd4f service nova] Creating event network-vif-plugged:24a2724b-5bec-4b7b-938e-508059f058d4 for instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 on hv-cinder-86022 Oct 31 14:57:38.120046 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-795a3c6e-2a89-42e8-97ef-d48f0f0982c5 req-2c25b1c2-ba50-4810-879d-6bc8e20fbd4f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062350 Oct 31 14:57:38.120805 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 71/161] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:38.126045 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:38.260159 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:38.268750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c6d40228-e775-488f-a3ea-8b00d1ab6dd1 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.193249 Oct 31 14:57:38.269349 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 91/162] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:38 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:38.503278 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:38.504167 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:38.512154 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.513099 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.513799 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.514712 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.515360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.516029 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.756869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:38.757997 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:38.765424 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.765909 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.766520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.767430 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.767885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.768302 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.881014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:38.893430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-88d9b562-5ed6-48ad-a4a5-1b2346c66891 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1514 microversion: 2.1 time: 0.395482 Oct 31 14:57:38.895459 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 72/163] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:38 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1514 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:38.918821 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:38.924116 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:38.935817 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.936608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.938495 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.940755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.941751 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.942400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.961403 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:38.970299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ecda0501-b83b-430f-880d-c64f6220db53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.217328 Oct 31 14:57:38.979586 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 92/164] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:38 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:38.985612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:38.985612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:38.995647 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.996165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.996600 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:38.997697 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:38.998150 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lazy-loading 'flavor' on Instance uuid c9e71890-419f-41a8-8e60-cd53d110c7ba {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:57:38.998468 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:38.999037 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:39.211760 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-804bf036-cd4a-43e1-b182-5620422ad78b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba/action" status: 200 len: 32 microversion: 2.1 time: 0.296751 Oct 31 14:57:39.216811 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 73/165] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 14:57:38 2022] POST /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:57:39.223209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:39.224166 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:39.233172 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:39.233665 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:39.234102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:39.235315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:39.235804 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:39.236401 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:39.244225 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:39.255274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:39.259276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:39.262040 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7a17f560-0233-4656-80a1-65bd6ec62244 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1408 microversion: 2.20 time: 0.284990 Oct 31 14:57:39.262837 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 93/166] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:38 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:39.293790 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:39.294782 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:39.312067 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:39.313402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:39.314692 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:39.318190 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:39.318866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:39.319995 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:39.471723 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:39.499224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-60b87314-062f-4205-980a-c9b8b8467890 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.272434 Oct 31 14:57:39.503105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 74/167] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:39 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:39.514687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:39.537606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cc2f8798-bd75-47e4-bfa6-e5f09713f449 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.248475 Oct 31 14:57:39.538822 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 94/168] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:39 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:39.996558 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:39.997809 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:40.004232 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.004928 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.005629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:40.006461 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.007083 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.008293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:40.031019 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:40.188145 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:40.199159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-653c0445-ea86-4d48-bedf-d127c881c682 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.204249 Oct 31 14:57:40.200886 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 75/169] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:39 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:40.288439 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:40.289184 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:40.295335 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.295872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.296293 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:40.297219 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.297670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.298093 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:40.486824 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:40.499661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:40.501504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:40.502911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1c366859-cb45-4f83-8fd9-faf6e46fdbce tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1601 microversion: 2.20 time: 0.218257 Oct 31 14:57:40.503591 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 95/170] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:57:40 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:57:40.533389 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ccc23f69-0d9e-4fa5-8672-f8c384306beb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:40.534419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ccc23f69-0d9e-4fa5-8672-f8c384306beb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:40.536561 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:40.537324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:40.541649 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ccc23f69-0d9e-4fa5-8672-f8c384306beb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.542585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ccc23f69-0d9e-4fa5-8672-f8c384306beb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.543379 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ccc23f69-0d9e-4fa5-8672-f8c384306beb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:40.544404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ccc23f69-0d9e-4fa5-8672-f8c384306beb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.545175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ccc23f69-0d9e-4fa5-8672-f8c384306beb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.545800 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ccc23f69-0d9e-4fa5-8672-f8c384306beb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:40.547883 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.548374 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.550385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:40.551134 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.551618 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.552035 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:40.740186 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ccc23f69-0d9e-4fa5-8672-f8c384306beb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.211733 Oct 31 14:57:40.740773 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 96/171] 10.222.0.36 () {60 vars in 1316 bytes} [Mon Oct 31 14:57:40 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-interface => generated 285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:57:40.755658 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:40.756524 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:40.764402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.765085 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.765856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:40.766715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:40.767368 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:40.768069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:41.125963 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:41.133936 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-09e7500d-8543-49fd-b436-5347251e29b9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.616841 Oct 31 14:57:41.141619 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 76/172] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:40 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:41.229506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:41.230493 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:41.241666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:41.242938 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:41.243869 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:41.244995 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:41.246654 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:41.247957 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:41.429258 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:41.442540 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d7a122db-d0b1-47b6-b9aa-6b5ce75636bd tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1361 microversion: 2.1 time: 0.690695 Oct 31 14:57:41.444284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 97/173] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:40 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1361 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:41.556150 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:41.566943 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-badca041-a104-4c71-9d55-4ecd12783929 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.345215 Oct 31 14:57:41.567537 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 77/174] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:41 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:42.162654 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:42.163267 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:42.172219 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:42.173305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:42.173958 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:42.175098 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:42.175738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:42.184231 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:42.469723 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:42.471285 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:42.480974 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:42.497294 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:42.497799 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:42.498242 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:42.498940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:42.499821 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:42.500383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:42.501261 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6c5067e5-001a-4733-b1a8-f132946a78ab tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.341809 Oct 31 14:57:42.502058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 98/175] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:42 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:42.592479 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:42.593345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:42.609046 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:42.611142 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:42.611643 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:42.613851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:42.617629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:42.619012 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:42.792962 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:42.821304 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-afbc929e-f24d-41b0-a6b3-95a943c39d04 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1546 microversion: 2.1 time: 0.356837 Oct 31 14:57:42.823279 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 78/176] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:42 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1546 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:42.851864 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ec3bf75f-a68f-4501-927d-63604e309d5e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:42.853956 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ec3bf75f-a68f-4501-927d-63604e309d5e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:42.861927 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ec3bf75f-a68f-4501-927d-63604e309d5e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:42.862541 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ec3bf75f-a68f-4501-927d-63604e309d5e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:42.863236 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ec3bf75f-a68f-4501-927d-63604e309d5e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:42.864139 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ec3bf75f-a68f-4501-927d-63604e309d5e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:42.865304 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ec3bf75f-a68f-4501-927d-63604e309d5e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:42.866171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ec3bf75f-a68f-4501-927d-63604e309d5e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:43.053201 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ec3bf75f-a68f-4501-927d-63604e309d5e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205893 Oct 31 14:57:43.062897 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 79/177] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 31 14:57:42 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:57:43.184465 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:43.198416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1501736c-b94c-433d-897f-08fecb5181d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.609425 Oct 31 14:57:43.199546 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 99/178] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:42 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:43.411999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-a0d699bb-5d7b-4153-b0a4-c3f4393b3e81 req-08ffcbb4-3f69-4f03-8a32-2104da83f4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214568bd-3ebf-4f91-8153-d60959d49119", "tag": "6951bd8b-ac72-4ceb-9344-47d91749e055"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:43.424285 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-a0d699bb-5d7b-4153-b0a4-c3f4393b3e81 req-08ffcbb4-3f69-4f03-8a32-2104da83f4b6 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:43.425055 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-a0d699bb-5d7b-4153-b0a4-c3f4393b3e81 req-08ffcbb4-3f69-4f03-8a32-2104da83f4b6 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:43.425742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-a0d699bb-5d7b-4153-b0a4-c3f4393b3e81 req-08ffcbb4-3f69-4f03-8a32-2104da83f4b6 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:43.542700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:43.543384 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:43.551366 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:43.552168 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:43.552850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:43.553826 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:43.554474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:43.555088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:43.641875 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-a0d699bb-5d7b-4153-b0a4-c3f4393b3e81 req-08ffcbb4-3f69-4f03-8a32-2104da83f4b6 service nova] Creating event network-changed:6951bd8b-ac72-4ceb-9344-47d91749e055 for instance 214568bd-3ebf-4f91-8153-d60959d49119 on hv-cinder-86022 Oct 31 14:57:43.649389 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-a0d699bb-5d7b-4153-b0a4-c3f4393b3e81 req-08ffcbb4-3f69-4f03-8a32-2104da83f4b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241306 Oct 31 14:57:43.650764 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 80/179] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:43.785998 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:43.802773 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8976c337-7915-4450-b106-35e0b4ceb472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.266404 Oct 31 14:57:43.803629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 100/180] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:43 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:44.239924 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:44.242750 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:44.262190 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:44.264419 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:44.265169 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:44.266078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:44.266683 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:44.267325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:44.436036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-40e86e35-0196-4b31-a0ed-5e70619fd3f7 req-76086139-42b3-4c0a-85e8-c4b0d907a4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f3404c-864a-4f8c-9444-8b3740b79f7b", "name": "network-vif-plugged", "status": "completed", "tag": "066e375b-5369-47d6-9723-3f3d6ad24590"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:44.454429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-40e86e35-0196-4b31-a0ed-5e70619fd3f7 req-76086139-42b3-4c0a-85e8-c4b0d907a4ac service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:44.454798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-40e86e35-0196-4b31-a0ed-5e70619fd3f7 req-76086139-42b3-4c0a-85e8-c4b0d907a4ac service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:44.455212 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-40e86e35-0196-4b31-a0ed-5e70619fd3f7 req-76086139-42b3-4c0a-85e8-c4b0d907a4ac service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:44.491672 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-40e86e35-0196-4b31-a0ed-5e70619fd3f7 req-76086139-42b3-4c0a-85e8-c4b0d907a4ac service nova] Creating event network-vif-plugged:066e375b-5369-47d6-9723-3f3d6ad24590 for instance 90f3404c-864a-4f8c-9444-8b3740b79f7b on hv-cinder-86022 Oct 31 14:57:44.497099 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-40e86e35-0196-4b31-a0ed-5e70619fd3f7 req-76086139-42b3-4c0a-85e8-c4b0d907a4ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064508 Oct 31 14:57:44.497998 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 101/181] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:44.832374 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:44.833420 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:44.841149 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:44.841645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:44.842243 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:44.842954 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:44.843406 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:44.844067 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:44.958147 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:44.975321 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-121ceaa2-749a-4c0c-b15c-b5ebaabe24d5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.749433 Oct 31 14:57:44.976173 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 81/182] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:44 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:45.100513 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:45.112013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0df6f643-cff0-4bc8-9acf-c029badbea58 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.283706 Oct 31 14:57:45.116786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 102/183] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:44 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:45.418902 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-6a5b6fd5-1cd6-4346-897f-381062affd94 req-a5ac48c0-3de0-4551-93f0-835777405e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820c59dc-ee1a-4470-b9d6-14060ebd8337", "tag": "24a2724b-5bec-4b7b-938e-508059f058d4"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:45.429626 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-6a5b6fd5-1cd6-4346-897f-381062affd94 req-a5ac48c0-3de0-4551-93f0-835777405e26 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:45.430343 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-6a5b6fd5-1cd6-4346-897f-381062affd94 req-a5ac48c0-3de0-4551-93f0-835777405e26 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:45.430970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-6a5b6fd5-1cd6-4346-897f-381062affd94 req-a5ac48c0-3de0-4551-93f0-835777405e26 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:45.445125 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-6a5b6fd5-1cd6-4346-897f-381062affd94 req-a5ac48c0-3de0-4551-93f0-835777405e26 service nova] Creating event network-changed:24a2724b-5bec-4b7b-938e-508059f058d4 for instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 on hv-cinder-86022 Oct 31 14:57:45.451696 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-6a5b6fd5-1cd6-4346-897f-381062affd94 req-a5ac48c0-3de0-4551-93f0-835777405e26 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038470 Oct 31 14:57:45.452577 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 82/184] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:46.003650 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:46.008771 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:46.025389 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:46.029587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:46.030405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:46.036127 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:46.038275 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:46.039173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:46.141123 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:46.142466 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:46.157470 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:46.158302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:46.162163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:46.163169 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:46.164020 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:46.166496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:46.429929 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:46.439111 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4ba7c378-c751-4395-a4ec-2cb3dc9e728a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.443728 Oct 31 14:57:46.439739 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 103/185] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:45 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:46.563830 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:46.564332 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:46.572273 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:46.572988 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:46.573570 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:46.574419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:46.575015 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:46.575718 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:46.613865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Going to try to terminate instance {{(pid=134339) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:57:46.616618 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:46.628658 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a56b8137-9509-40fc-84e6-1a82c1f2472a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.492029 Oct 31 14:57:46.629764 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 83/186] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:46 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:46.749431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-670e3185-b700-4d7d-8d11-08607698c8d8 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 204 len: 0 microversion: 2.1 time: 0.191060 Oct 31 14:57:46.750356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 104/187] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 14:57:46 2022] DELETE /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:57:46.758690 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:46.759960 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:46.769810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:46.770280 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:46.770729 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:46.771527 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:46.772368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:46.772881 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:46.922934 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:46.932557 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6571b9c5-98cf-42af-a12a-2f548979478d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1554 microversion: 2.1 time: 0.177828 Oct 31 14:57:46.933139 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 84/188] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:46 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:47.466658 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:47.467517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:47.489605 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:47.490293 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:47.490721 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:47.492218 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:47.492715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:47.493247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:47.649472 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:47.656318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:47.657753 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:47.658396 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-98234045-f05d-45f9-a5e9-8abac9cdfdb4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.196941 Oct 31 14:57:47.660172 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 105/189] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:47 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:47.668016 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:47.675901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:47.676531 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:47.677318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:47.677826 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:47.678280 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:47.836250 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:47.845016 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-75ef4acc-c836-44d8-83f6-53b35b91c3c2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.194071 Oct 31 14:57:47.846166 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 85/190] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:47 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:47.960872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:47.961777 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:47.969109 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:47.969587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:47.970014 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:47.970877 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:47.971490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:47.972234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:48.140555 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:48.149451 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-fbfac376-3bb7-4b93-8e53-28401c82426e tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1554 microversion: 2.1 time: 0.193352 Oct 31 14:57:48.150746 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 106/191] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:47 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:48.687535 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:48.688419 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:48.695308 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:48.695880 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:48.697163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:48.698206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:48.698718 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:48.699203 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:48.870219 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:48.870818 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:48.879519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:48.880398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:48.881156 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:48.882428 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:48.883036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:48.883636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:49.000338 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:49.022893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a187eb3c-72f9-4a64-a30e-384a4fbaae58 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1367 microversion: 2.1 time: 0.339221 Oct 31 14:57:49.023971 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 86/192] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:48 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:49.086327 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:49.178060 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:49.185572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:49.193418 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:49.194338 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:49.194935 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:49.196351 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:49.199626 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:49.200439 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:49.273793 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:49.314089 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-622347fe-3fad-4cf0-93ff-4244de54b38c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.436433 Oct 31 14:57:49.314089 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 107/193] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:48 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:49.410104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:49.420707 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a1c9d225-758c-4263-8866-fbd95ad84aad tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1554 microversion: 2.1 time: 0.248079 Oct 31 14:57:49.421839 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 87/194] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:49 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:50.052938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:50.053782 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:50.077445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:50.078158 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:50.078816 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:50.082290 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:50.087859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:50.088377 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:50.347916 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:50.350748 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:50.372077 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:50.372799 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:50.373325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:50.374126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:50.374783 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:50.375313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:50.387311 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:50.401147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1496be67-dc32-4eb4-a713-714a424b14ee tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1557 microversion: 2.1 time: 0.355715 Oct 31 14:57:50.411658 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 108/195] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:50 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1557 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:50.430194 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1dc75deb-26af-48e4-8448-b989427dd7b0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:50.431865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1dc75deb-26af-48e4-8448-b989427dd7b0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:50.450623 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dc75deb-26af-48e4-8448-b989427dd7b0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:50.451251 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dc75deb-26af-48e4-8448-b989427dd7b0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:50.452105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dc75deb-26af-48e4-8448-b989427dd7b0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:50.453328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dc75deb-26af-48e4-8448-b989427dd7b0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:50.481066 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dc75deb-26af-48e4-8448-b989427dd7b0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:50.481517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dc75deb-26af-48e4-8448-b989427dd7b0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:50.610480 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:50.620972 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b08fb575-39f9-42c2-b9ea-8ff077757924 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.286327 Oct 31 14:57:50.621408 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 88/196] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:50 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:50.636119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1dc75deb-26af-48e4-8448-b989427dd7b0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196885 Oct 31 14:57:50.636119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 109/197] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 31 14:57:50 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:50.636516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-25f2ec80-0b89-4262-abc0-dde1f9b18059 req-ffa75abf-6ec7-4632-96fa-be29d03d1ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c93f4d-15ed-4113-95ad-b6766332779e", "name": "network-vif-deleted", "tag": "3f33f9e8-094c-4cdc-84e0-fcaac96a6b7a"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:50.638370 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:50.644091 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:50.655494 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:50.656013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:50.656449 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:50.657134 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:50.657586 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:50.658000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:50.664907 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-25f2ec80-0b89-4262-abc0-dde1f9b18059 req-ffa75abf-6ec7-4632-96fa-be29d03d1ccb service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:50.666514 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-25f2ec80-0b89-4262-abc0-dde1f9b18059 req-ffa75abf-6ec7-4632-96fa-be29d03d1ccb service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:50.669599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-25f2ec80-0b89-4262-abc0-dde1f9b18059 req-ffa75abf-6ec7-4632-96fa-be29d03d1ccb service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:50.704089 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-25f2ec80-0b89-4262-abc0-dde1f9b18059 req-ffa75abf-6ec7-4632-96fa-be29d03d1ccb service nova] Creating event network-vif-deleted:3f33f9e8-094c-4cdc-84e0-fcaac96a6b7a for instance f1c93f4d-15ed-4113-95ad-b6766332779e on hv-cinder-86022 Oct 31 14:57:50.716660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-25f2ec80-0b89-4262-abc0-dde1f9b18059 req-ffa75abf-6ec7-4632-96fa-be29d03d1ccb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090169 Oct 31 14:57:50.720948 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 89/198] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:50.803015 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77af489d5daa4d028b737c5f4efc93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af86d70d54694b7995d03c8c607ae706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:50.813988 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c471a38a-2aef-489c-b803-a1cd6ab8d99d tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 200 len: 1346 microversion: 2.1 time: 0.190150 Oct 31 14:57:50.817317 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 110/199] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:50 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 1346 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:51.650939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:51.653544 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:51.664212 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:51.666022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:51.667042 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:51.667964 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:51.668583 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:51.671765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:51.840079 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:51.841699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:51.850770 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:51.851395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:51.851920 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:51.853370 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:51.854407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:51.854892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:51.872656 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] HTTP exception thrown: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Request method failure captured: Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e HTTP/1.1 Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-Il8GdVO8gPB3fCr5XaJnRBpDD-1i0ALR3xvzh8GmJ96qrgrXYsmP8aOvC0efLkjKmL6FicDb6Hcpjc0qu8ZL3ETukMreFd9mt37pRPpGfRWUkMRnp4OH6D8k9YkgyFUXdSCkoPYAxyLpYWaHIImlqZ56EEu0XPUkg8dknYxr0pemI Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: af86d70d54694b7995d03c8c607ae706 Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 14:57:51.901008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/af86d70d54694b7995d03c8c607ae706"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/af86d70d54694b7995d03c8c607ae706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_af86d70d54694b7995d03c8c607ae706"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/af86d70d54694b7995d03c8c607ae706"}]}] Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: af86d70d54694b7995d03c8c607ae706 Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-DeleteServersTestJSON-1142135178-project Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 77af489d5daa4d028b737c5f4efc93db Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-DeleteServersTestJSON-1142135178-project Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:51.902247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': 'f1c93f4d-15ed-4113-95ad-b6766332779e'} Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:57:51.902917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:51.905063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:51.906082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Returning 404 to user: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:57:51.906082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b3debe66-cd68-4adb-8ef9-48763145fd92 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 404 len: 111 microversion: 2.1 time: 0.067044 Oct 31 14:57:51.906082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 111/200] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:51 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:57:52.017349 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:52.022533 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:52.025109 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:52.026599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e33e102d-a615-4b4f-80ce-539738fc7442 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.381659 Oct 31 14:57:52.034980 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 90/201] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:51 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:52.036436 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:52.037161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:52.037792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:52.038696 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:52.041497 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:52.042163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:52.066608 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] HTTP exception thrown: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Request method failure captured: Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e/os-volume_attachments HTTP/1.1 Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-Il8GdVO8gPB3fCr5XaJnRBpDD-1i0ALR3xvzh8GmJ96qrgrXYsmP8aOvC0efLkjKmL6FicDb6Hcpjc0qu8ZL3ETukMreFd9mt37pRPpGfRWUkMRnp4OH6D8k9YkgyFUXdSCkoPYAxyLpYWaHIImlqZ56EEu0XPUkg8dknYxr0pemI Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: af86d70d54694b7995d03c8c607ae706 Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 14:57:52.075931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/af86d70d54694b7995d03c8c607ae706"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/af86d70d54694b7995d03c8c607ae706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_af86d70d54694b7995d03c8c607ae706"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/af86d70d54694b7995d03c8c607ae706"}]}] Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: af86d70d54694b7995d03c8c607ae706 Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-DeleteServersTestJSON-1142135178-project Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 77af489d5daa4d028b737c5f4efc93db Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-DeleteServersTestJSON-1142135178-project Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:52.077132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'server_id': 'f1c93f4d-15ed-4113-95ad-b6766332779e'} Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:57:52.078025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:52.079021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:52.081961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Returning 404 to user: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:57:52.083361 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c68e55a9-8d05-428f-811e-ed70d1f23004 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064873 Oct 31 14:57:52.086508 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 112/202] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 14:57:52 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:57:52.753613 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-3594cea5-803a-437b-9761-aae025366a74 req-e342a90e-6acb-49aa-8943-112165a0abca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90f3404c-864a-4f8c-9444-8b3740b79f7b", "tag": "066e375b-5369-47d6-9723-3f3d6ad24590"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:57:52.779188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-3594cea5-803a-437b-9761-aae025366a74 req-e342a90e-6acb-49aa-8943-112165a0abca service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:52.781474 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-3594cea5-803a-437b-9761-aae025366a74 req-e342a90e-6acb-49aa-8943-112165a0abca service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:52.782662 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-3594cea5-803a-437b-9761-aae025366a74 req-e342a90e-6acb-49aa-8943-112165a0abca service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:52.811771 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-3594cea5-803a-437b-9761-aae025366a74 req-e342a90e-6acb-49aa-8943-112165a0abca service nova] Creating event network-changed:066e375b-5369-47d6-9723-3f3d6ad24590 for instance 90f3404c-864a-4f8c-9444-8b3740b79f7b on hv-cinder-86022 Oct 31 14:57:52.835904 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-3594cea5-803a-437b-9761-aae025366a74 req-e342a90e-6acb-49aa-8943-112165a0abca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085912 Oct 31 14:57:52.837442 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 91/203] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:57:53.052638 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:53.053249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:53.077026 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:53.078720 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:53.079170 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:53.083106 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:53.088104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:53.089730 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:53.374027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:53.385722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:53.418027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:53.419768 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:53.426069 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:53.427134 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:53.427818 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:53.428518 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:53.461234 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] HTTP exception thrown: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.468213 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Request method failure captured: Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: DELETE /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e HTTP/1.1 Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-Il8GdVO8gPB3fCr5XaJnRBpDD-1i0ALR3xvzh8GmJ96qrgrXYsmP8aOvC0efLkjKmL6FicDb6Hcpjc0qu8ZL3ETukMreFd9mt37pRPpGfRWUkMRnp4OH6D8k9YkgyFUXdSCkoPYAxyLpYWaHIImlqZ56EEu0XPUkg8dknYxr0pemI Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: af86d70d54694b7995d03c8c607ae706 Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 14:57:53.478496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/af86d70d54694b7995d03c8c607ae706"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/af86d70d54694b7995d03c8c607ae706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_af86d70d54694b7995d03c8c607ae706"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/af86d70d54694b7995d03c8c607ae706"}]}] Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: af86d70d54694b7995d03c8c607ae706 Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-DeleteServersTestJSON-1142135178-project Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: 77af489d5daa4d028b737c5f4efc93db Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-DeleteServersTestJSON-1142135178-project Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.479955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': 'f1c93f4d-15ed-4113-95ad-b6766332779e'} Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:57:53.480633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.481693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.485682 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Returning 404 to user: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:57:53.490378 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-136b4f82-f828-4592-86e3-ef0513aacda8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.441513 Oct 31 14:57:53.490979 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 113/204] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:53 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:57:53.512555 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-89118963-d53b-4c40-9eb7-3cca89a0ab91 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 404 len: 111 microversion: 2.1 time: 0.120060 Oct 31 14:57:53.514973 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 92/205] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 14:57:53 2022] DELETE /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:57:53.523585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:53.524615 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] [instance: f1c93f4d-15ed-4113-95ad-b6766332779e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:53.531949 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:53.532890 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:53.533592 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:53.537303 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:53.539096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:53.541278 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:53.578393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] HTTP exception thrown: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Request method failure captured: Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e HTTP/1.1 Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-Il8GdVO8gPB3fCr5XaJnRBpDD-1i0ALR3xvzh8GmJ96qrgrXYsmP8aOvC0efLkjKmL6FicDb6Hcpjc0qu8ZL3ETukMreFd9mt37pRPpGfRWUkMRnp4OH6D8k9YkgyFUXdSCkoPYAxyLpYWaHIImlqZ56EEu0XPUkg8dknYxr0pemI Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: af86d70d54694b7995d03c8c607ae706 Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 14:57:53.581606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/af86d70d54694b7995d03c8c607ae706"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/af86d70d54694b7995d03c8c607ae706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_af86d70d54694b7995d03c8c607ae706"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/af86d70d54694b7995d03c8c607ae706"}]}] Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: af86d70d54694b7995d03c8c607ae706 Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-DeleteServersTestJSON-1142135178 Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-DeleteServersTestJSON-1142135178-project Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 77af489d5daa4d028b737c5f4efc93db Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-DeleteServersTestJSON-1142135178-project Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.583166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': 'f1c93f4d-15ed-4113-95ad-b6766332779e'} Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:57:53.583928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. Oct 31 14:57:53.585076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:57:53.587579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] Returning 404 to user: Instance f1c93f4d-15ed-4113-95ad-b6766332779e could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:57:53.587579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-67a4d3bf-f02a-4b56-bfde-d9e8a9e8de42 tempest-DeleteServersTestJSON-1142135178 tempest-DeleteServersTestJSON-1142135178-project] 10.222.0.36 "GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e" status: 404 len: 111 microversion: 2.1 time: 0.065185 Oct 31 14:57:53.587579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 114/206] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:53 2022] GET /compute/v2.1/servers/f1c93f4d-15ed-4113-95ad-b6766332779e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 14:57:54.516838 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:54.518968 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:54.530845 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:54.531348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:54.534116 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:54.534956 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:54.535485 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:54.536538 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:54.777293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:54.790542 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-11ca4a14-cb5e-4b70-9d22-654aa445fd05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.277748 Oct 31 14:57:54.807711 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 93/207] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:54 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:55.822589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:55.823932 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:55.831244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:55.832069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:55.833081 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:55.833920 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:55.834720 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:55.838211 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:56.249595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:56.258259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9df5b2af-f1c3-4511-b19e-c297edee7c00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.440231 Oct 31 14:57:56.273156 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 115/208] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:55 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:57.292017 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:57.292841 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:57.304508 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:57.306887 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:57.307690 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:57.308820 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:57.309720 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:57.310275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:57.644464 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:57.653445 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7227fdfc-3065-4e0f-bc5e-e52f379d93a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.366688 Oct 31 14:57:57.660653 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 94/209] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:57 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:58.686423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:58.687612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:58.693632 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:58.694113 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:58.694540 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:58.695227 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:58.695701 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:58.696623 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:58.877043 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:57:58.889237 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-39f50c7d-16e4-4d47-8519-5f91e5946f8c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.206584 Oct 31 14:57:58.892210 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 116/210] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:58 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:57:59.915861 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:57:59.916428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:57:59.924473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:59.925036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:59.925939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:57:59.926842 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:57:59.927296 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:57:59.927761 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:00.097232 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:00.099512 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=100 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:00.115131 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2d0e0404-1569-48fd-897e-8875331442ac tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.203826 Oct 31 14:58:00.115732 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 95/211] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:57:59 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:00.641191 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5d9f8c01-5254-4980-8ca2-8703be16e42a tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Action: 'create', calling method: .version_select at 0x7f6c7108cdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-203608254", "metadata": {"Type": "work"}}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5d9f8c01-5254-4980-8ca2-8703be16e42a tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Request method failure captured: Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 121 Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-J4A5_oWJGen0HCPC1pdLdNcYjAkqsCwA5Qbo4GVjbaYauRAbZFbXTkIUagxZg3LWx83JhGM4pt1ne455Vb49yRji4z60x9lHnh7Alai1cdPmXH0eKbiROiQwpwUZVXDa3OwKfNlMWh4WYTmYv2JH3PmvTVBD3kx-nO1ZyQBCXhAqQ Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 14:58:00.656309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d8b9979a32d4f019261033e05440917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d8b9979a32d4f019261033e05440917"}]}] Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: c4ef2932d19241abb23fabeff26f4617 Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-203608254", "metadata": {"Type": "work"}}} Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: Oct 31 14:58:00.658256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-203608254', 'metadata': {'Type': 'work'}}}} Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi '#$%' Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:00.658969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:58:00.660670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:58:00.662265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 14:58:00.662265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.662265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5d9f8c01-5254-4980-8ca2-8703be16e42a tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:00.662265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5d9f8c01-5254-4980-8ca2-8703be16e42a tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.162486 Oct 31 14:58:00.662265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 117/212] 10.222.0.36 () {60 vars in 1156 bytes} [Mon Oct 31 14:58:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:58:00.669538 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-37693e8d-ac42-4bef-9430-20183cf98dc3 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Action: 'create', calling method: .version_select at 0x7f6c7100d550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-107063623", "metadata": {"Type": "work"}}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-37693e8d-ac42-4bef-9430-20183cf98dc3 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Request method failure captured: Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 119 Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-J4A5_oWJGen0HCPC1pdLdNcYjAkqsCwA5Qbo4GVjbaYauRAbZFbXTkIUagxZg3LWx83JhGM4pt1ne455Vb49yRji4z60x9lHnh7Alai1cdPmXH0eKbiROiQwpwUZVXDa3OwKfNlMWh4WYTmYv2JH3PmvTVBD3kx-nO1ZyQBCXhAqQ Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 14:58:00.674789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d8b9979a32d4f019261033e05440917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d8b9979a32d4f019261033e05440917"}]}] Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: c4ef2932d19241abb23fabeff26f4617 Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-107063623", "metadata": {"Type": "work"}}} Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: Oct 31 14:58:00.676275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-107063623', 'metadata': {'Type': 'work'}}}} Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi '0' Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:00.677235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:58:00.678615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:58:00.679846 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 14:58:00.679846 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.679846 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-37693e8d-ac42-4bef-9430-20183cf98dc3 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:00.681336 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-37693e8d-ac42-4bef-9430-20183cf98dc3 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016182 Oct 31 14:58:00.682130 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 96/213] 10.222.0.36 () {60 vars in 1156 bytes} [Mon Oct 31 14:58:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:58:00.692372 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-18a284a4-26b8-4d01-9945-c23d0d9de3e0 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Action: 'create', calling method: .version_select at 0x7f6c71184b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-804310663", "metadata": {"Type": "work"}}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-18a284a4-26b8-4d01-9945-c23d0d9de3e0 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Request method failure captured: Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 118 Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-J4A5_oWJGen0HCPC1pdLdNcYjAkqsCwA5Qbo4GVjbaYauRAbZFbXTkIUagxZg3LWx83JhGM4pt1ne455Vb49yRji4z60x9lHnh7Alai1cdPmXH0eKbiROiQwpwUZVXDa3OwKfNlMWh4WYTmYv2JH3PmvTVBD3kx-nO1ZyQBCXhAqQ Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 14:58:00.696755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d8b9979a32d4f019261033e05440917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d8b9979a32d4f019261033e05440917"}]}] Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: c4ef2932d19241abb23fabeff26f4617 Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-804310663", "metadata": {"Type": "work"}}} Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: Oct 31 14:58:00.698097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-804310663', 'metadata': {'Type': 'work'}}}} Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise error Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi '' Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:00.698895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 14:58:00.700148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 14:58:00.701128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 14:58:00.701128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.701128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-18a284a4-26b8-4d01-9945-c23d0d9de3e0 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:00.701128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-18a284a4-26b8-4d01-9945-c23d0d9de3e0 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010397 Oct 31 14:58:00.701128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 118/214] 10.222.0.36 () {60 vars in 1156 bytes} [Mon Oct 31 14:58:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 14:58:00.709007 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-20f37ff1-1777-4d63-b963-876b130b4b2a tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Calling method '.version_select at 0x7f6c71009c10>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:00.745012 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-20f37ff1-1777-4d63-b963-876b130b4b2a tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] HTTP exception thrown: Volume tempest-invalid-870632422 could not be found. Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-20f37ff1-1777-4d63-b963-876b130b4b2a tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Request method failure captured: Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-870632422 HTTP/1.1 Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-J4A5_oWJGen0HCPC1pdLdNcYjAkqsCwA5Qbo4GVjbaYauRAbZFbXTkIUagxZg3LWx83JhGM4pt1ne455Vb49yRji4z60x9lHnh7Alai1cdPmXH0eKbiROiQwpwUZVXDa3OwKfNlMWh4WYTmYv2JH3PmvTVBD3kx-nO1ZyQBCXhAqQ Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 14:58:00.746930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d8b9979a32d4f019261033e05440917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d8b9979a32d4f019261033e05440917"}]}] Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: c4ef2932d19241abb23fabeff26f4617 Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Volume tempest-invalid-870632422 could not be found. Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': 'tempest-invalid-870632422'} Oct 31 14:58:00.748174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-870632422 could not be found. (HTTP 404) (Request-ID: req-2b1950cb-7bab-4559-9725-9ad6995f872d) Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.749084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:58:00.750438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-870632422 could not be found. Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:00.751929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-870632422 could not be found. Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-870632422 could not be found. Oct 31 14:58:00.753317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.754916 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-20f37ff1-1777-4d63-b963-876b130b4b2a tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Returning 404 to user: Volume tempest-invalid-870632422 could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:00.755939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-20f37ff1-1777-4d63-b963-876b130b4b2a tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-870632422" status: 404 len: 98 microversion: 2.1 time: 0.051211 Oct 31 14:58:00.756757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 97/215] 10.222.0.36 () {58 vars in 1215 bytes} [Mon Oct 31 14:58:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-870632422 => generated 98 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:58:00.771400 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5020f0d5-ec32-4fcf-9eda-63dca74722a3 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003900 Oct 31 14:58:00.771943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 119/216] 10.222.0.36 () {58 vars in 1140 bytes} [Mon Oct 31 14:58:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 14:58:00.781971 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-05ed2d38-5e82-42d3-b931-cf9edf50d818 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004394 Oct 31 14:58:00.783605 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 98/217] 10.222.0.36 () {58 vars in 1137 bytes} [Mon Oct 31 14:58:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 14:58:00.792953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ae52cfb2-adc1-4267-a1b7-74812a009765 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Calling method '.version_select at 0x7f6c71184d30>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:00.834883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-ae52cfb2-adc1-4267-a1b7-74812a009765 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] HTTP exception thrown: Volume 91d56a47-9595-4dee-937d-abd3862ef3ba could not be found. Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ae52cfb2-adc1-4267-a1b7-74812a009765 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Request method failure captured: Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: DELETE /compute/v2.1/os-volumes/91d56a47-9595-4dee-937d-abd3862ef3ba HTTP/1.1 Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-J4A5_oWJGen0HCPC1pdLdNcYjAkqsCwA5Qbo4GVjbaYauRAbZFbXTkIUagxZg3LWx83JhGM4pt1ne455Vb49yRji4z60x9lHnh7Alai1cdPmXH0eKbiROiQwpwUZVXDa3OwKfNlMWh4WYTmYv2JH3PmvTVBD3kx-nO1ZyQBCXhAqQ Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 14:58:00.838239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d8b9979a32d4f019261033e05440917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d8b9979a32d4f019261033e05440917"}]}] Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: c4ef2932d19241abb23fabeff26f4617 Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Volume 91d56a47-9595-4dee-937d-abd3862ef3ba could not be found. Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '91d56a47-9595-4dee-937d-abd3862ef3ba'} Oct 31 14:58:00.839376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91d56a47-9595-4dee-937d-abd3862ef3ba could not be found. (HTTP 404) (Request-ID: req-404ecf5a-b3c9-4a82-bc4f-bf44dd1126ae) Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.840128 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 14:58:00.841102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91d56a47-9595-4dee-937d-abd3862ef3ba could not be found. Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 14:58:00.842071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91d56a47-9595-4dee-937d-abd3862ef3ba could not be found. Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91d56a47-9595-4dee-937d-abd3862ef3ba could not be found. Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ae52cfb2-adc1-4267-a1b7-74812a009765 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Returning 404 to user: Volume 91d56a47-9595-4dee-937d-abd3862ef3ba could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ae52cfb2-adc1-4267-a1b7-74812a009765 tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/91d56a47-9595-4dee-937d-abd3862ef3ba" status: 404 len: 109 microversion: 2.1 time: 0.051102 Oct 31 14:58:00.843034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 120/218] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 14:58:00 2022] DELETE /compute/v2.1/os-volumes/91d56a47-9595-4dee-937d-abd3862ef3ba => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:58:00.853893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8394cccf-18af-4143-86b4-6cc94af6642e tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Calling method '.version_select at 0x7f6c71068af0>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:00.894511 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-8394cccf-18af-4143-86b4-6cc94af6642e tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] HTTP exception thrown: Volume 22c4e1a8-176b-4d83-8792-a7cc58a01e7e could not be found. Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8394cccf-18af-4143-86b4-6cc94af6642e tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Request method failure captured: Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/os-volumes/22c4e1a8-176b-4d83-8792-a7cc58a01e7e HTTP/1.1 Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-J4A5_oWJGen0HCPC1pdLdNcYjAkqsCwA5Qbo4GVjbaYauRAbZFbXTkIUagxZg3LWx83JhGM4pt1ne455Vb49yRji4z60x9lHnh7Alai1cdPmXH0eKbiROiQwpwUZVXDa3OwKfNlMWh4WYTmYv2JH3PmvTVBD3kx-nO1ZyQBCXhAqQ Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 14:58:00.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d8b9979a32d4f019261033e05440917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d8b9979a32d4f019261033e05440917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d8b9979a32d4f019261033e05440917"}]}] Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 6d8b9979a32d4f019261033e05440917 Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-VolumesNegativeTest-2016874626 Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: c4ef2932d19241abb23fabeff26f4617 Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-VolumesNegativeTest-2016874626-project Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Volume 22c4e1a8-176b-4d83-8792-a7cc58a01e7e could not be found. Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '22c4e1a8-176b-4d83-8792-a7cc58a01e7e'} Oct 31 14:58:00.898252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22c4e1a8-176b-4d83-8792-a7cc58a01e7e could not be found. (HTTP 404) (Request-ID: req-ca40d783-ec9b-40ed-86a9-673444c7f567) Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.899224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 14:58:00.900610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22c4e1a8-176b-4d83-8792-a7cc58a01e7e could not be found. Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 14:58:00.901835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22c4e1a8-176b-4d83-8792-a7cc58a01e7e could not be found. Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22c4e1a8-176b-4d83-8792-a7cc58a01e7e could not be found. Oct 31 14:58:00.903048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:00.906475 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8394cccf-18af-4143-86b4-6cc94af6642e tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] Returning 404 to user: Volume 22c4e1a8-176b-4d83-8792-a7cc58a01e7e could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:00.907706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8394cccf-18af-4143-86b4-6cc94af6642e tempest-VolumesNegativeTest-2016874626 tempest-VolumesNegativeTest-2016874626-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/22c4e1a8-176b-4d83-8792-a7cc58a01e7e" status: 404 len: 109 microversion: 2.1 time: 0.060977 Oct 31 14:58:00.908547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 99/219] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 14:58:00 2022] GET /compute/v2.1/os-volumes/22c4e1a8-176b-4d83-8792-a7cc58a01e7e => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:58:01.142404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:01.143017 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:01.145020 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:01.150881 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:01.151378 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:01.152145 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:01.152862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:01.153324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:01.153754 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:01.303012 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:01.311005 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-de99b992-530a-43f6-b84c-4eb47f980e0c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.172508 Oct 31 14:58:01.311592 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 121/220] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:01 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:02.335602 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:02.336824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:02.343105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=59 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:02.350224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:02.351026 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:02.352893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:02.354168 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:02.355289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:02.355902 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:02.533599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:02.546284 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d4dc2756-f49c-46e6-8af7-4761ecc09013 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.215761 Oct 31 14:58:02.561609 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 100/221] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:02 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:03.575363 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:03.576532 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:03.587702 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:03.588764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:03.589248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:03.590131 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:03.590645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:03.591018 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:03.806276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:03.817659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-699d3560-4e42-4afd-9ac3-3a95744eaec4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.248346 Oct 31 14:58:03.818245 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 122/222] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:03 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:04.693702 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-869921701", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "networks": [{"uuid": "bf316978-b229-4eee-925c-84469c566017"}]}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:04.759630 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] validate_networks() for [('bf316978-b229-4eee-925c-84469c566017', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:58:04.844228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:04.845426 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:04.853783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:04.854266 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:04.854698 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:04.855392 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:04.855861 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:04.856280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:05.081226 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:05.096229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d028ead8-d43d-4f31-8342-fd4180f1bb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.256374 Oct 31 14:58:05.098378 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 123/223] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:04 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:05.514700 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:58:05.515435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:58:05.516316 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:58:05.516821 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:58:05.517706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:58:05.534500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:05.535262 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:05.536159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:05.538565 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:05.539625 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:05.540276 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:05.568160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Getting quotas for project 4075982a0ef04a6a8edbe37fde6cb657. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:58:05.575473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Getting quotas for user dd1d89a64c274cefb03a68c3233cfa51 and project 4075982a0ef04a6a8edbe37fde6cb657. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:58:05.603737 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:58:05.603737 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:58:05.656479 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-761410af-caa6-430e-af0a-7298ccd93d50 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966459 Oct 31 14:58:05.657301 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 101/224] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:58:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:58:05.669756 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5d2bb48c-6795-4371-8aa3-24efb06a3578 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:05.670449 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5d2bb48c-6795-4371-8aa3-24efb06a3578 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:05.740835 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5d2bb48c-6795-4371-8aa3-24efb06a3578 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:05.750046 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5d2bb48c-6795-4371-8aa3-24efb06a3578 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1213 microversion: 2.1 time: 0.084293 Oct 31 14:58:05.754892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 124/225] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:05 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:06.122406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:06.124392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:06.133927 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:06.134417 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:06.135375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:06.137478 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:06.138556 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:06.139932 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:06.310666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:06.325536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9f0d3955-1832-4fe8-9d7d-b5ca0fd47223 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.205431 Oct 31 14:58:06.326396 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 102/226] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:06 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:06.784469 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:06.785127 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:06.794428 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:06.795248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:06.795938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:06.796922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:06.798143 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:06.798837 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:06.880047 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:06.889845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4ca69175-bcb3-4428-a57b-e85ec4cc707f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1265 microversion: 2.1 time: 0.112614 Oct 31 14:58:06.890402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 125/227] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:06 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:07.354387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:07.355590 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:07.371101 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:07.372295 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:07.372924 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:07.373814 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:07.381570 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:07.382338 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:07.678498 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:07.689333 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-fcc9aa32-7c67-43a4-97b6-16af85feca68 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.340418 Oct 31 14:58:07.690545 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 103/228] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:07 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:07.916921 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:07.919411 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:07.934700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:07.936520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:07.937675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:07.938597 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:07.939053 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:07.939683 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:08.056618 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:08.066404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1192a709-b07f-4ae2-83b0-ff07710f93a8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1271 microversion: 2.1 time: 0.155619 Oct 31 14:58:08.067164 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 126/229] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:07 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:08.715169 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:08.716405 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:08.723833 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:08.724522 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:08.725479 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:08.726529 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:08.727109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:08.727669 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:08.995269 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:09.017151 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f65a37e9-b730-4225-92f3-ff734cdf0cd7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.295059 Oct 31 14:58:09.018537 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 104/230] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:08 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:09.092112 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:09.093348 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:09.099964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:09.100681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:09.101268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:09.102992 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:09.103635 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:09.104211 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:09.265177 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-a10b1406-3052-4bd3-8223-1621f0bf70b2 req-bc5cab3c-9ef2-4623-87da-de9fd9c12fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e92708-d9b2-4f8e-890e-519efad1f1ec", "tag": "9c1dd4b1-3efd-42d1-9e04-0d74d1c92ac3"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:09.288174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-a10b1406-3052-4bd3-8223-1621f0bf70b2 req-bc5cab3c-9ef2-4623-87da-de9fd9c12fc4 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:09.288949 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-a10b1406-3052-4bd3-8223-1621f0bf70b2 req-bc5cab3c-9ef2-4623-87da-de9fd9c12fc4 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:09.289565 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-a10b1406-3052-4bd3-8223-1621f0bf70b2 req-bc5cab3c-9ef2-4623-87da-de9fd9c12fc4 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:09.293926 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:09.307034 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-a10b1406-3052-4bd3-8223-1621f0bf70b2 req-bc5cab3c-9ef2-4623-87da-de9fd9c12fc4 service nova] Creating event network-changed:9c1dd4b1-3efd-42d1-9e04-0d74d1c92ac3 for instance c4e92708-d9b2-4f8e-890e-519efad1f1ec on hv-cinder-86022 Oct 31 14:58:09.319063 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-a10b1406-3052-4bd3-8223-1621f0bf70b2 req-bc5cab3c-9ef2-4623-87da-de9fd9c12fc4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058374 Oct 31 14:58:09.320456 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 105/231] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:58:09.329516 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-86f270f0-ab54-41e7-a8fd-a3c87165828a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.241291 Oct 31 14:58:09.336414 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 127/232] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:09 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:10.046127 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:10.047503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:10.055942 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:10.056646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:10.057491 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:10.058329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:10.058990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:10.059572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:10.224205 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:10.234130 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-bb95d660-962e-4189-a217-235f5b858ee9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.192106 Oct 31 14:58:10.234706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 106/233] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:10 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:10.357729 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:10.358979 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:10.365820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:10.366554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:10.368527 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:10.370033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:10.371225 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:10.371950 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:10.613362 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:10.626847 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-19da41d8-f6f5-4772-b1f5-8bfebca4a76a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.272054 Oct 31 14:58:10.628742 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 128/234] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:10 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:11.262404 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:11.263008 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:11.269378 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:11.269852 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:11.270277 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:11.270955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:11.271429 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:11.271872 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:11.494884 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:11.502506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0c783705-8632-452c-93ba-c5819d7badbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.243972 Oct 31 14:58:11.503187 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 107/235] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:11 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:11.651000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:11.651519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:11.657518 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:11.657994 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:11.658428 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:11.659112 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:11.659581 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:11.659990 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:11.809389 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:11.817034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1dcc7312-a4a7-4fe2-a27b-3215a13fba30 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.169891 Oct 31 14:58:11.817593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 129/236] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:11 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:12.526818 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:12.527506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:12.534544 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:12.535030 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:12.535870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:12.536182 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:12.536631 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:12.537789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:12.678300 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:12.686375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2ce9db2e-ef5b-4ad3-9490-054464f00a4c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.164286 Oct 31 14:58:12.687008 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 108/237] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:12 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:12.841543 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:12.842180 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:12.848235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:12.848708 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:12.849131 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:12.849806 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:12.850253 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:12.850666 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:12.982740 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:12.990276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1dd2fab1-e2e3-47a9-879f-eba40fb2cbf5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.153423 Oct 31 14:58:12.990825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 130/238] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:12 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:13.711153 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:13.712487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:13.722834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:13.723454 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:13.725592 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:13.726879 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:13.727336 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:13.727839 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:13.860317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:13.870042 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a96ef5d7-036f-4c58-9a46-98f304d9de61 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.163933 Oct 31 14:58:13.870801 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 109/239] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:13 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:14.014398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:14.015011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:14.021241 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:14.021743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:14.022165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:14.022865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:14.024042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:14.024560 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:14.040315 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:14.163252 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:14.171146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4d08e565-a51a-4f22-a876-cd62ec4f89db tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.160650 Oct 31 14:58:14.171748 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 131/240] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:14 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:14.896111 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:14.896815 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:14.906850 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:14.906850 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:14.906850 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:14.906850 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:14.907194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:14.907194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:15.041619 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:15.050224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9b81767b-7a34-4874-98f6-ad440eeb850a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.158455 Oct 31 14:58:15.050785 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 110/241] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:14 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:15.195838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:15.196907 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:15.202798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:15.203273 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:15.203742 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:15.204458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:15.204909 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:15.205327 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:15.345241 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:15.354298 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-af0b76ee-0f1b-4860-8665-d4166afe0240 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.162859 Oct 31 14:58:15.354859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 132/242] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:15 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:16.073713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:16.074868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:16.078491 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:16.079427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=6 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:16.085254 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.086521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.087285 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.088041 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.088766 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.089453 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.270139 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:16.280471 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-00eb6ca3-63f5-4d78-861d-7bfc565b70f0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.210582 Oct 31 14:58:16.281463 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 111/243] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:16 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:16.370653 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-6eac17b0-dfec-4d08-8846-d2e7f2847a8b req-752828e8-f905-402c-8d9d-98530dd86b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e92708-d9b2-4f8e-890e-519efad1f1ec", "name": "network-vif-plugged", "status": "completed", "tag": "9c1dd4b1-3efd-42d1-9e04-0d74d1c92ac3"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:16.376746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:16.377348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:16.379447 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:16.383987 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-6eac17b0-dfec-4d08-8846-d2e7f2847a8b req-752828e8-f905-402c-8d9d-98530dd86b1c service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.384716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-6eac17b0-dfec-4d08-8846-d2e7f2847a8b req-752828e8-f905-402c-8d9d-98530dd86b1c service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.385306 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-6eac17b0-dfec-4d08-8846-d2e7f2847a8b req-752828e8-f905-402c-8d9d-98530dd86b1c service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.389530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.390160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.390899 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.391876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:16.392765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:16.394514 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:16.402675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-6eac17b0-dfec-4d08-8846-d2e7f2847a8b req-752828e8-f905-402c-8d9d-98530dd86b1c service nova] Creating event network-vif-plugged:9c1dd4b1-3efd-42d1-9e04-0d74d1c92ac3 for instance c4e92708-d9b2-4f8e-890e-519efad1f1ec on hv-cinder-86022 Oct 31 14:58:16.408686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-6eac17b0-dfec-4d08-8846-d2e7f2847a8b req-752828e8-f905-402c-8d9d-98530dd86b1c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041962 Oct 31 14:58:16.409772 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 133/244] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:16.533902 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:16.541835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5076a79f-d424-43be-a1c3-6728bbe2daeb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.168896 Oct 31 14:58:16.542396 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 112/245] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:16 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:17.307296 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:17.308048 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:17.314169 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:17.314644 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:17.315090 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:17.315780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:17.316289 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:17.316625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:17.453087 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:17.462699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-57242944-e385-49a4-8252-4d829cef66d9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.160071 Oct 31 14:58:17.476771 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 134/246] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:17 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:17.565614 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:17.566353 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:17.574654 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:17.575190 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:17.575711 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:17.576635 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:17.577080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:17.577492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:17.750679 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:17.761861 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6eaa701b-1ea7-48bc-9391-06502ed71b9c tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.199535 Oct 31 14:58:17.762523 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 113/247] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:17 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:18.486893 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:18.487507 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:18.493521 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:18.493997 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:18.494431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:18.495121 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:18.495584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:18.496010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:18.627490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:18.635619 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-fd13d66f-9825-405d-a032-e8705eed6e84 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.152613 Oct 31 14:58:18.636432 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 135/248] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:18 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:18.789891 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:18.790500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:18.796943 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:18.797418 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:18.797844 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:18.798522 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:18.799031 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:18.799459 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:18.930101 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:18.937703 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c1db0a28-6879-4e91-a25f-f6baa3cbb6c7 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.151614 Oct 31 14:58:18.938255 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 114/249] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:18 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:19.659281 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:19.659930 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:19.665849 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:19.666324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:19.666751 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:19.667424 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:19.667896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:19.668311 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:19.798592 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:19.808055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0b59964a-c472-4544-a840-666b2a994dbb tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.152730 Oct 31 14:58:19.808628 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 136/250] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:19 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:19.961229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:19.961824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:19.968366 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:19.968840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:19.969269 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:19.969948 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:19.970392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:19.970808 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:20.106037 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:20.114389 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-95cb2c87-09a6-4ddc-97ae-b3344a1e38cd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1313 microversion: 2.1 time: 0.156939 Oct 31 14:58:20.115027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 115/251] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:19 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:20.831934 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:20.832546 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:20.838777 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:20.839438 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:20.839903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:20.840584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:20.841034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:20.841453 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:20.984813 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:20.993896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b56943b3-b814-47dc-a389-b733ce44cea7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.166031 Oct 31 14:58:21.008940 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 137/252] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:20 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:21.138597 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:21.139210 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:21.145786 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:21.146324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:21.146772 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:21.148051 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:21.148556 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:21.148984 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:21.282595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:21.291526 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-56bffd15-b74e-4d1c-8e51-fe613a7b1acc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1497 microversion: 2.1 time: 0.157212 Oct 31 14:58:21.292122 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 116/253] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:21 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:22.018151 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:22.018759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:22.024677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:22.025155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:22.025585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:22.026259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:22.026702 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:22.027123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:22.164852 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:22.172684 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7a1a930e-9843-48c5-99fe-9b1a551568e8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.158351 Oct 31 14:58:22.173267 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 138/254] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:22 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:23.195604 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:23.196210 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:23.202784 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:23.203262 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:23.203769 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:23.204484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:23.204943 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:23.205367 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:23.332325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:23.334493 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=100 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:23.341168 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a34f8977-73b0-486f-84cc-4f58ce3a2241 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.149503 Oct 31 14:58:23.341737 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 117/255] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:23 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:24.365241 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:24.366656 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:24.374530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:24.375025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:24.375440 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:24.376147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:24.376640 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:24.377006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:24.518499 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:24.526973 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2ebec73a-164b-4774-8129-1b957e32f000 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1520 microversion: 2.1 time: 0.165463 Oct 31 14:58:24.527546 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 139/256] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:24 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:24.575512 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:24.576211 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:24.583098 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:24.583655 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:24.584259 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:24.585715 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:24.586349 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:24.586912 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:24.619898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:58:24.719751 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f6993dec-834c-4372-a2f2-3f92b70fd18f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 204 len: 0 microversion: 2.1 time: 0.148192 Oct 31 14:58:24.720326 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 118/257] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 14:58:24 2022] DELETE /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:58:24.728653 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:24.729432 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:24.735711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:24.736200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:24.736636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:24.737684 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:24.738141 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:24.738565 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:24.889021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:24.898949 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f2d5a0da-aa19-442b-b571-e3dc96a9aa22 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1503 microversion: 2.1 time: 0.174248 Oct 31 14:58:24.899981 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 140/258] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:24 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:25.551849 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:25.552542 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:25.558773 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:25.559251 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:25.559709 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:25.560400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:25.560849 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:25.561269 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:25.696640 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:25.704541 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3da66aa6-8bf4-4236-856e-8dfbd38db46b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1500 microversion: 2.1 time: 0.156913 Oct 31 14:58:25.705101 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 119/259] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:25 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:25.731088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:25.731697 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:25.737775 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:25.738263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:25.738698 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:25.739412 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:25.740001 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:25.740437 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:25.880676 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:25.889398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8eece825-e577-4802-ac84-fc49982fcf00 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1515 microversion: 2.1 time: 0.162467 Oct 31 14:58:25.889980 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 141/260] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:25 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:25.926473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:25.927257 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:25.935281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:25.935800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:25.936228 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:25.936916 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:25.937359 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:25.937771 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:26.115331 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:26.125343 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-250b2732-569b-4236-b0f4-5913c6c1b88e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1503 microversion: 2.1 time: 0.203623 Oct 31 14:58:26.125999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 120/261] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:25 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:27.154472 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:27.155104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:27.168380 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:27.169735 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:27.170526 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:27.172203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:27.173606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:27.177897 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:27.422878 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:27.435262 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-23cd77bd-ace1-4e3f-8ffc-e66adc8a8381 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1503 microversion: 2.1 time: 0.285226 Oct 31 14:58:27.448377 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 142/262] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:27 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:27.458377 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:27.461803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:27.476455 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:27.476942 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:27.477563 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:27.478263 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:27.478881 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:27.479514 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:27.505040 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lazy-loading 'flavor' on Instance uuid b8e52643-da13-4beb-85c9-fd94d0330a8b {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:58:27.633130 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e630ca7d-fc60-43f9-bf98-f6155cad4873 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b/action" status: 200 len: 32 microversion: 2.1 time: 0.178649 Oct 31 14:58:27.634318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 121/263] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 14:58:27 2022] POST /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 14:58:27.645369 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:27.646061 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:27.661804 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:27.662274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:27.663284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:27.666684 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-e9b1954e-4114-40b3-a54c-12e76e455a33 req-e2ee7397-eb8f-48d7-80e5-09571fc480eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e92708-d9b2-4f8e-890e-519efad1f1ec", "name": "network-vif-deleted", "tag": "9c1dd4b1-3efd-42d1-9e04-0d74d1c92ac3"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:27.671630 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:27.672670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:27.673291 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:27.681347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-e9b1954e-4114-40b3-a54c-12e76e455a33 req-e2ee7397-eb8f-48d7-80e5-09571fc480eb service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:27.681831 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-e9b1954e-4114-40b3-a54c-12e76e455a33 req-e2ee7397-eb8f-48d7-80e5-09571fc480eb service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:27.682499 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-e9b1954e-4114-40b3-a54c-12e76e455a33 req-e2ee7397-eb8f-48d7-80e5-09571fc480eb service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:27.708643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-e9b1954e-4114-40b3-a54c-12e76e455a33 req-e2ee7397-eb8f-48d7-80e5-09571fc480eb service nova] Creating event network-vif-deleted:9c1dd4b1-3efd-42d1-9e04-0d74d1c92ac3 for instance c4e92708-d9b2-4f8e-890e-519efad1f1ec on hv-cinder-86022 Oct 31 14:58:27.721043 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-e9b1954e-4114-40b3-a54c-12e76e455a33 req-e2ee7397-eb8f-48d7-80e5-09571fc480eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064632 Oct 31 14:58:27.722979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 122/264] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:27.867321 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:27.875203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d0e45037-2e45-4110-bad5-064fdc34d359 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.234996 Oct 31 14:58:27.875962 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 143/265] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:27 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:28.461376 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:28.462630 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:28.468784 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:28.469513 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:28.470096 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:28.470807 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:28.471264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:28.472438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:28.517079 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:28.517531 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:28.517970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:28.518423 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lazy-loading 'fault' on Instance uuid c4e92708-d9b2-4f8e-890e-519efad1f1ec {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:58:28.602091 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:28.620579 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7702b25a-2ac8-4587-9a0d-5a7a7680c3a5 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 200 len: 1303 microversion: 2.1 time: 0.163729 Oct 31 14:58:28.621496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 123/266] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:28 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:28.907306 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:28.907968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:28.917541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:28.918765 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:28.919421 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:28.920850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:28.922080 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:28.933333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:29.092477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:29.102921 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5e060d82-da00-40a1-9497-af95ee476912 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.204327 Oct 31 14:58:29.104056 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 144/267] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:28 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:29.645065 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:29.645826 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: c4e92708-d9b2-4f8e-890e-519efad1f1ec] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:29.654044 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:29.655142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:29.655614 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:29.656482 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:29.656942 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:29.657368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:29.672747 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] HTTP exception thrown: Instance c4e92708-d9b2-4f8e-890e-519efad1f1ec could not be found. Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Request method failure captured: Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec HTTP/1.1 Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-J6MYWH8UjiKM84EWUaSJl9jrH1cNFNY1eyBhbeF2w3ZcMPzr8eFyNbYjp4KaNDtOPpCpwmj-fgS_s_bcTqlLp-9WUe_MuvrUkVU7whdYjn2k6fLAhoJ3ZLLWfjgW2ISZHTZIolmFNrKek2_SytRSx-HkVhA-D2V0Km-2DNgdmitys Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 4075982a0ef04a6a8edbe37fde6cb657 Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-VolumesActionsTest-1534383339 Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 14:58:29.674332 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4075982a0ef04a6a8edbe37fde6cb657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4075982a0ef04a6a8edbe37fde6cb657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4075982a0ef04a6a8edbe37fde6cb657"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4075982a0ef04a6a8edbe37fde6cb657"}]}] Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-VolumesActionsTest-1534383339 Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 4075982a0ef04a6a8edbe37fde6cb657 Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-VolumesActionsTest-1534383339 Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-VolumesActionsTest-1534383339-project Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: dd1d89a64c274cefb03a68c3233cfa51 Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-VolumesActionsTest-1534383339-project Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance c4e92708-d9b2-4f8e-890e-519efad1f1ec could not be found. Oct 31 14:58:29.675657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': 'c4e92708-d9b2-4f8e-890e-519efad1f1ec'} Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4e92708-d9b2-4f8e-890e-519efad1f1ec could not be found. Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:29.676375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e92708-d9b2-4f8e-890e-519efad1f1ec could not be found. Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e92708-d9b2-4f8e-890e-519efad1f1ec could not be found. Oct 31 14:58:29.678985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:29.680187 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Returning 404 to user: Instance c4e92708-d9b2-4f8e-890e-519efad1f1ec could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:29.680187 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1038ac04-82ae-440c-a844-1fc912fc8203 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec" status: 404 len: 111 microversion: 2.1 time: 0.035107 Oct 31 14:58:29.680187 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 124/268] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:29 2022] GET /compute/v2.1/servers/c4e92708-d9b2-4f8e-890e-519efad1f1ec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:58:29.781938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-730360940", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "networks": [{"uuid": "bf316978-b229-4eee-925c-84469c566017"}]}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:29.842769 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] validate_networks() for [('bf316978-b229-4eee-925c-84469c566017', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:58:30.127002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:30.127602 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:30.133898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:30.134586 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:30.135036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:30.135750 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:30.136198 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:30.136615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:30.202940 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:58:30.203414 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:58:30.203837 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:58:30.204240 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:58:30.204645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:58:30.215789 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:30.216270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:30.217523 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:30.218230 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:30.218686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:30.219115 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:30.236306 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Getting quotas for project 4075982a0ef04a6a8edbe37fde6cb657. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:58:30.240667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Getting quotas for user dd1d89a64c274cefb03a68c3233cfa51 and project 4075982a0ef04a6a8edbe37fde6cb657. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:58:30.252567 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:58:30.255257 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:58:30.304387 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ce4a705a-f048-4ee9-bea9-8997bcac9434 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526474 Oct 31 14:58:30.305350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 145/269] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:58:30.316899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0462b6e8-3bd0-4a8a-aed4-b80c4515d59f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:30.317569 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0462b6e8-3bd0-4a8a-aed4-b80c4515d59f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:30.343643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:30.352197 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c848b386-b121-4f07-b777-983400fd723e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.229398 Oct 31 14:58:30.353029 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 125/270] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:30 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:30.385382 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0462b6e8-3bd0-4a8a-aed4-b80c4515d59f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:30.393705 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0462b6e8-3bd0-4a8a-aed4-b80c4515d59f tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1213 microversion: 2.1 time: 0.080997 Oct 31 14:58:30.394260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 146/271] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:30 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:31.376065 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:31.376905 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:31.385183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:31.385763 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:31.386479 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:31.387242 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:31.387788 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:31.388274 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:31.418413 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:31.425314 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:31.435371 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:31.439923 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:31.440599 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:31.441180 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:31.442026 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:31.442619 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:31.443198 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:31.520631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:31.534203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-40580465-4ae6-4083-b7da-7d98c5b5e98e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1265 microversion: 2.1 time: 0.119332 Oct 31 14:58:31.535017 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 147/272] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:31 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:31.574281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:31.584895 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7a8cbf7f-86e5-4850-9039-47a52917d19c tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.212604 Oct 31 14:58:31.585866 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 126/273] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:31 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:32.558691 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:32.559310 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:32.565242 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:32.565727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:32.566163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:32.566851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:32.567306 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:32.567761 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:32.612845 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:32.613368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:32.616217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:32.632797 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:32.633293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:32.633772 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:32.634659 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:32.635320 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:32.635791 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:32.715876 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:32.724045 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7f8364e3-fef6-486f-9369-499591f04dcd tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1313 microversion: 2.1 time: 0.169191 Oct 31 14:58:32.724799 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 148/274] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:32 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:32.882762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:32.898158 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-96087ee7-5974-4a8f-b0e1-a51477583642 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.289097 Oct 31 14:58:32.900824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 127/275] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:32 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:33.116551 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-8d50aff2-f8c1-4762-979f-58a631c041b1 req-dd17e0e2-f789-45bc-8ba0-02566542a923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707946b1-50c7-4df0-9e3a-036d755eeeea", "tag": "17fecc69-75e1-4f2b-9dd2-f3d84e691f51"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:33.128125 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-8d50aff2-f8c1-4762-979f-58a631c041b1 req-dd17e0e2-f789-45bc-8ba0-02566542a923 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:33.128599 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-8d50aff2-f8c1-4762-979f-58a631c041b1 req-dd17e0e2-f789-45bc-8ba0-02566542a923 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:33.129076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-8d50aff2-f8c1-4762-979f-58a631c041b1 req-dd17e0e2-f789-45bc-8ba0-02566542a923 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:33.142955 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-8d50aff2-f8c1-4762-979f-58a631c041b1 req-dd17e0e2-f789-45bc-8ba0-02566542a923 service nova] Creating event network-changed:17fecc69-75e1-4f2b-9dd2-f3d84e691f51 for instance 707946b1-50c7-4df0-9e3a-036d755eeeea on hv-cinder-86022 Oct 31 14:58:33.149267 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-8d50aff2-f8c1-4762-979f-58a631c041b1 req-dd17e0e2-f789-45bc-8ba0-02566542a923 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037419 Oct 31 14:58:33.150078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 149/276] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:58:33.747147 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:33.747802 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:33.754314 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:33.754784 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:33.755208 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:33.755908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:33.756584 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:33.756995 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:33.885200 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:33.892710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a8a2433f-fca9-4446-8d1d-8ef03f45a670 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1313 microversion: 2.1 time: 0.149391 Oct 31 14:58:33.893265 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 128/277] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:33 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:33.922483 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:33.923180 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:33.929781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:33.930247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:33.930672 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:33.931369 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:33.931839 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:33.932250 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:34.062869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:34.070951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-df67b261-5a3e-499e-97f3-d7eeb827196b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.152648 Oct 31 14:58:34.071508 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 150/278] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:33 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:34.916566 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:34.917167 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:34.923532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:34.924030 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:34.924454 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:34.925129 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:34.925570 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:34.925982 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:35.055994 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:35.063845 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-26dd58f9-a1ed-4ca0-ab21-8926c3bd7961 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1313 microversion: 2.1 time: 0.151592 Oct 31 14:58:35.064400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 129/279] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:34 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:35.093987 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:35.094593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:35.101209 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:35.101681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:35.102111 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:35.102794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:35.103236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:35.103692 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:35.106263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:35.230391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:35.238004 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d329f0c5-32ca-497d-b649-7a244c24983b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.147812 Oct 31 14:58:35.238553 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 151/280] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:35 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:36.087118 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:36.087763 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:36.094595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:36.095075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:36.095507 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:36.096221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:36.096668 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:36.097087 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:36.233268 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:36.244839 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-80cef410-5aa2-4052-a3b7-32b7d89f92bb tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1313 microversion: 2.1 time: 0.158993 Oct 31 14:58:36.244839 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 130/281] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:36 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:36.261501 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:36.262181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:36.268475 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:36.269051 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:36.269661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:36.270358 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:36.270815 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:36.271272 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:36.288890 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-af74226d-551e-411d-946c-fd1525042e72 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:36.289633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-af74226d-551e-411d-946c-fd1525042e72 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:36.296020 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af74226d-551e-411d-946c-fd1525042e72 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:36.296616 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af74226d-551e-411d-946c-fd1525042e72 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:36.297221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af74226d-551e-411d-946c-fd1525042e72 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:36.297900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af74226d-551e-411d-946c-fd1525042e72 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:36.298416 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af74226d-551e-411d-946c-fd1525042e72 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:36.298901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af74226d-551e-411d-946c-fd1525042e72 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:36.338989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-af74226d-551e-411d-946c-fd1525042e72 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/ips" status: 200 len: 152 microversion: 2.20 time: 0.054723 Oct 31 14:58:36.339588 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 131/282] 10.222.0.36 () {60 vars in 1289 bytes} [Mon Oct 31 14:58:36 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/ips => generated 152 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:58:36.426259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:36.434651 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a2651ebd-c289-415b-844e-6a71bf279c62 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.176980 Oct 31 14:58:36.435384 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 152/283] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:36 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:37.265059 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:37.265800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:37.272428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:37.272903 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:37.273335 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:37.274014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:37.274458 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:37.274876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:37.277444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:37.459232 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:37.459896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:37.465842 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:37.466321 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:37.466745 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:37.467429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:37.467925 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:37.468343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:37.494882 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:37.502858 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0c5a0b34-2518-4449-ad89-5c33a31d77d8 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1313 microversion: 2.1 time: 0.241678 Oct 31 14:58:37.503425 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 132/284] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:37 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:37.600211 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:37.608061 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8beefe03-5556-43ec-be84-2c350fb3692f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.153004 Oct 31 14:58:37.608706 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 153/285] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:37 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:38.526915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:38.527449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:38.534571 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:38.535083 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:38.535753 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:38.536295 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:38.536768 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:38.537219 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:38.632295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:38.633050 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:38.639014 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:38.639607 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:38.640104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:38.640852 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:38.641366 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:38.641851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:38.665536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:38.673521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-543cce6c-68f0-49cd-9ee6-c9c5406a8156 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1313 microversion: 2.1 time: 0.150574 Oct 31 14:58:38.674078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 133/286] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:38 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:38.769784 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:38.778880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-fbccd308-d84a-40bf-94f8-e3e689308292 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.150924 Oct 31 14:58:38.779481 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 154/287] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:38 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:39.696429 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:39.697090 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:39.708501 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:39.709472 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:39.709904 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:39.710594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:39.711045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:39.711463 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:39.802070 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:39.802786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:39.808778 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:39.809268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:39.809702 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:39.810397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:39.810846 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:39.811265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:39.847400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:39.856946 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-79cd0626-ff0d-431b-b54d-1b089e885c2e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1313 microversion: 2.1 time: 0.164234 Oct 31 14:58:39.857554 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 134/288] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:39 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:39.948803 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:39.956672 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-47bb1500-f480-42de-93be-363e44a00194 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.158463 Oct 31 14:58:39.957216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 155/289] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:39 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:40.232211 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:40.232746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:40.238510 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.238981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.239406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.240136 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.240870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.241289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.264178 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lazy-loading 'flavor' on Instance uuid 214568bd-3ebf-4f91-8153-d60959d49119 {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:58:40.465704 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-f50713e5-ba61-4dce-81d4-7e25c428e8e1 req-a0dea6c0-dda9-4373-81e9-61feef4fa173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707946b1-50c7-4df0-9e3a-036d755eeeea", "name": "network-vif-plugged", "status": "completed", "tag": "17fecc69-75e1-4f2b-9dd2-f3d84e691f51"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:40.476818 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:40.477521 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=8 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:40.479750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-f50713e5-ba61-4dce-81d4-7e25c428e8e1 req-a0dea6c0-dda9-4373-81e9-61feef4fa173 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.480411 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-f50713e5-ba61-4dce-81d4-7e25c428e8e1 req-a0dea6c0-dda9-4373-81e9-61feef4fa173 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.480992 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-f50713e5-ba61-4dce-81d4-7e25c428e8e1 req-a0dea6c0-dda9-4373-81e9-61feef4fa173 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.494217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-f50713e5-ba61-4dce-81d4-7e25c428e8e1 req-a0dea6c0-dda9-4373-81e9-61feef4fa173 service nova] Creating event network-vif-plugged:17fecc69-75e1-4f2b-9dd2-f3d84e691f51 for instance 707946b1-50c7-4df0-9e3a-036d755eeeea on hv-cinder-86022 Oct 31 14:58:40.499464 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-f50713e5-ba61-4dce-81d4-7e25c428e8e1 req-a0dea6c0-dda9-4373-81e9-61feef4fa173 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037354 Oct 31 14:58:40.500317 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 156/290] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:58:40.502965 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f74a5109-b896-42f6-94d6-b5dc8c8f5dbc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/action" status: 202 len: 0 microversion: 2.20 time: 0.273764 Oct 31 14:58:40.505066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 135/291] 10.222.0.36 () {62 vars in 1319 bytes} [Mon Oct 31 14:58:40 2022] POST /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:58:40.516581 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:40.518725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:40.531609 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.533414 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.534323 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.535207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.536451 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.537350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.709589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:40.718094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:40.719943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:40.721263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ea642abb-be7e-47fe-b138-40a16af6550d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.212147 Oct 31 14:58:40.721810 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 157/292] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:40 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:58:40.881989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:40.882691 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:40.889593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.890070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.890501 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.891184 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.891670 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.892090 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.980563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:40.981277 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:40.987732 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.988330 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.988955 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:40.989783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:40.991038 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:40.991643 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:41.022464 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:41.031209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3d61e3ec-def2-4d00-b094-83d67827158e tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1313 microversion: 2.1 time: 0.153991 Oct 31 14:58:41.032066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 136/293] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:40 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:41.121810 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:41.129437 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-db772dea-0d46-46b5-96fd-e8460efbcf36 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.152809 Oct 31 14:58:41.129991 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 158/294] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:40 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:41.334848 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f5835dcb-eb9b-4111-b73d-14d7ff725bbb tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:41.335352 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f5835dcb-eb9b-4111-b73d-14d7ff725bbb tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:41.341246 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5835dcb-eb9b-4111-b73d-14d7ff725bbb tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:41.341724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5835dcb-eb9b-4111-b73d-14d7ff725bbb tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:41.342149 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5835dcb-eb9b-4111-b73d-14d7ff725bbb tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:41.342829 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5835dcb-eb9b-4111-b73d-14d7ff725bbb tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:41.343276 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5835dcb-eb9b-4111-b73d-14d7ff725bbb tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:41.343725 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5835dcb-eb9b-4111-b73d-14d7ff725bbb tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:41.367428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f5835dcb-eb9b-4111-b73d-14d7ff725bbb tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/ips" status: 200 len: 145 microversion: 2.1 time: 0.037252 Oct 31 14:58:41.368033 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 137/295] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 14:58:41 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:41.748991 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:41.749858 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:41.756959 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:41.757840 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:41.758445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:41.759585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:41.760036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:41.760460 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:41.764791 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1035055730", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:41.820054 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] validate_networks() for None {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:58:41.899808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:41.908121 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:41.909565 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:41.910736 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b8bb1a56-268e-49a8-8c73-647cb11d0428 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.166117 Oct 31 14:58:41.911956 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 159/296] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:41 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:58:42.055039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:42.055687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:42.061853 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.062340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.062778 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:42.063485 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.063996 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.064418 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:42.201969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:42.210085 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-298cb692-287f-4612-add9-df4d0b9db23a tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1313 microversion: 2.1 time: 0.159578 Oct 31 14:58:42.210652 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 160/297] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:42 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:42.231108 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:42.231757 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:42.237615 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.238096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.238530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:42.239232 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.239691 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.240696 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:42.373024 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:42.380903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2ac050e7-560c-470f-9f06-d2cd2e50dd6b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.155621 Oct 31 14:58:42.381474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 161/298] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:42 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:42.405257 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:58:42.405713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:58:42.406235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:58:42.406665 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:58:42.407091 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:58:42.416527 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.416992 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.417417 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:42.418126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.418567 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.418977 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:42.436253 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Getting quotas for project 0d647ac8f50049dab664e81a70e106ca. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:58:42.440208 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Getting quotas for user d2da2ba5ff4a449ba678db76180c4cbd and project 0d647ac8f50049dab664e81a70e106ca. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:58:42.450850 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:58:42.453102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:58:42.499947 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e4c70d87-0b8b-4828-bb07-dc7ee8a3380f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738973 Oct 31 14:58:42.500586 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 138/299] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:58:42.511364 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9f72151b-ed25-435e-ab3c-b594a94e7b4c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:42.512002 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9f72151b-ed25-435e-ab3c-b594a94e7b4c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:42.569775 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9f72151b-ed25-435e-ab3c-b594a94e7b4c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:42.576600 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9f72151b-ed25-435e-ab3c-b594a94e7b4c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1215 microversion: 2.1 time: 0.068972 Oct 31 14:58:42.577165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 162/300] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:42 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:42.937942 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:42.938678 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:42.944979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.945457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.945894 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:42.946572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:42.947020 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:42.947439 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.075112 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:43.083473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:43.084900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:43.086051 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-adfed98a-c270-439c-8224-5981f092b0ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.152608 Oct 31 14:58:43.086605 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 139/301] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:42 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:43.236924 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:43.237538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:43.244844 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.245360 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.247136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.247136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.247136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.247647 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.383503 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:43.391439 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-070ab22c-f22f-4974-a9dd-e28e2ace2ffc tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1498 microversion: 2.1 time: 0.158276 Oct 31 14:58:43.392033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 163/302] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:43 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:43.404180 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:43.404891 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:43.410706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.411251 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.411623 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.413415 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.413558 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.413995 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.555618 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:43.563624 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ceb5ffc3-f98b-4773-ba8e-9a9bf7d4524a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.163493 Oct 31 14:58:43.564206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 140/303] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:43 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:43.601662 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:43.602424 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:43.609265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.609988 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.610620 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.611509 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.612197 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.612831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.678334 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:43.686122 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-bd4895fc-9d5d-4061-ba94-6eea3e1b30d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1211 microversion: 2.1 time: 0.089303 Oct 31 14:58:43.686774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 164/304] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:43 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:43.903223 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:43.903752 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:43.911677 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.912619 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.913345 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.914047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:43.914786 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:43.915493 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:43.947858 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:58:44.050261 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-62745cb1-4e37-49b9-857a-a214eb29f351 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "DELETE /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 204 len: 0 microversion: 2.1 time: 0.150815 Oct 31 14:58:44.054301 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 141/305] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 14:58:43 2022] DELETE /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:58:44.063312 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:44.064059 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:44.071726 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:44.072264 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:44.072716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:44.073459 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:44.073918 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:44.074530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:44.111497 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:44.112132 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:44.119007 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:44.119503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:44.119975 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:44.120675 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:44.121123 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:44.121541 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:44.210608 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:44.218364 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-61e69a00-d226-40d3-b35a-9e4bd01f6c10 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1504 microversion: 2.1 time: 0.159727 Oct 31 14:58:44.218933 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 165/306] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:44 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:44.255205 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:44.263793 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:44.265251 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:44.266401 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5ee47519-0ffe-4317-bf12-c37d05fa0d05 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.159193 Oct 31 14:58:44.266951 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 142/307] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:44 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:58:44.587050 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:44.587712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:44.593656 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:44.594136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:44.594572 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:44.595260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:44.595750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:44.596175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:44.709547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:44.710148 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:44.716043 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:44.716525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:44.716959 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:44.717644 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:44.718094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:44.718512 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:44.723819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:44.731961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8eb5355d-8078-46fb-ae8b-afe137e8551f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.149244 Oct 31 14:58:44.732514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 166/308] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:44 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:44.779178 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:44.787412 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2bbc1582-0ffc-404b-9a51-668a586733e4 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1267 microversion: 2.1 time: 0.081240 Oct 31 14:58:44.787945 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 143/309] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:44 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:45.082735 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-69f6740c-1533-4056-a2a3-db9541b24591 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec0b48fa-a7e1-44c3-9bfb-59b68b1d3ce1"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:45.085772 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-69f6740c-1533-4056-a2a3-db9541b24591 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:45.091869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-69f6740c-1533-4056-a2a3-db9541b24591 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.092358 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-69f6740c-1533-4056-a2a3-db9541b24591 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.092798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-69f6740c-1533-4056-a2a3-db9541b24591 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.093489 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-69f6740c-1533-4056-a2a3-db9541b24591 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.093943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-69f6740c-1533-4056-a2a3-db9541b24591 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.094370 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-69f6740c-1533-4056-a2a3-db9541b24591 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.241346 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:45.241961 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:45.248506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.248989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.249418 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.250137 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.250590 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.251008 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.387138 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:45.395537 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a291c620-b881-460d-9edd-a696085e0dd1 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1504 microversion: 2.1 time: 0.157970 Oct 31 14:58:45.396684 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 144/310] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:45 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:45.401060 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:45.401658 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:45.407799 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.408277 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.408716 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.409392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.409840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.410258 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.541153 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:45.549176 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:45.550620 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:45.551805 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0fb7e249-ee00-4d17-8ac0-ab063e21e5cd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.154184 Oct 31 14:58:45.552905 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 145/311] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:45 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:45.764762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:45.765541 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:45.773144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.773635 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.774065 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.774762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.775208 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.775672 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.781210 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:45.788817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-69f6740c-1533-4056-a2a3-db9541b24591 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709694 Oct 31 14:58:45.789792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 167/312] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 14:58:45 2022] POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:45.813570 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:45.814433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:45.828142 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.828813 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.829307 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.830082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:45.830810 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:45.831230 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:45.863777 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:45.903913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:45.912240 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-661bf9c3-424f-4818-a7a8-57dd44796c45 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1267 microversion: 2.1 time: 0.105551 Oct 31 14:58:45.912948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 168/313] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:45 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:46.038417 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:46.046196 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ce6fc799-0f52-4833-81d8-eee1dea0f23a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.294121 Oct 31 14:58:46.046755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 146/314] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:45 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:46.344637 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-72fd3c8a-5dbb-4486-b11d-bcbe32367454 req-4ef62ed9-b959-427a-8c23-545e3d8fd66b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707946b1-50c7-4df0-9e3a-036d755eeeea", "name": "network-vif-deleted", "tag": "17fecc69-75e1-4f2b-9dd2-f3d84e691f51"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:46.355564 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-72fd3c8a-5dbb-4486-b11d-bcbe32367454 req-4ef62ed9-b959-427a-8c23-545e3d8fd66b service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.356056 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-72fd3c8a-5dbb-4486-b11d-bcbe32367454 req-4ef62ed9-b959-427a-8c23-545e3d8fd66b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.356482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-72fd3c8a-5dbb-4486-b11d-bcbe32367454 req-4ef62ed9-b959-427a-8c23-545e3d8fd66b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.368759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-72fd3c8a-5dbb-4486-b11d-bcbe32367454 req-4ef62ed9-b959-427a-8c23-545e3d8fd66b service nova] Creating event network-vif-deleted:17fecc69-75e1-4f2b-9dd2-f3d84e691f51 for instance 707946b1-50c7-4df0-9e3a-036d755eeeea on hv-cinder-86022 Oct 31 14:58:46.373381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-72fd3c8a-5dbb-4486-b11d-bcbe32367454 req-4ef62ed9-b959-427a-8c23-545e3d8fd66b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032597 Oct 31 14:58:46.373945 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 169/315] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:46.418688 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:46.419295 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:46.425981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.426460 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.426920 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.427733 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.428183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.428629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.466103 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-35e9d80c-2bbe-4f54-b4e5-f6c1e3234714 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:46.466681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-35e9d80c-2bbe-4f54-b4e5-f6c1e3234714 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:46.473058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-35e9d80c-2bbe-4f54-b4e5-f6c1e3234714 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.473569 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-35e9d80c-2bbe-4f54-b4e5-f6c1e3234714 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.474608 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-35e9d80c-2bbe-4f54-b4e5-f6c1e3234714 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.475388 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-35e9d80c-2bbe-4f54-b4e5-f6c1e3234714 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.475878 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-35e9d80c-2bbe-4f54-b4e5-f6c1e3234714 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.476299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-35e9d80c-2bbe-4f54-b4e5-f6c1e3234714 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.494901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:46.499486 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-35e9d80c-2bbe-4f54-b4e5-f6c1e3234714 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037627 Oct 31 14:58:46.500178 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 170/316] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 14:58:46 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:58:46.503066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1e2194c5-40fd-4877-b87f-e61dbfe6702d tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1462 microversion: 2.1 time: 0.088158 Oct 31 14:58:46.504622 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 147/317] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:46 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:46.577458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:46.578054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:46.584990 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.585662 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.585985 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.586668 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.587112 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.587530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.730494 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:46.738869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:46.740621 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:46.741636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-88009187-0023-4fde-83aa-3183d765f816 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.168037 Oct 31 14:58:46.742186 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 171/318] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:46 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:46.938601 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:46.944277 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:46.964383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.964383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.964383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:46.964383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:46.964686 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:46.964686 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.022494 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:47.030086 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6dfcfceb-8c03-4d30-a236-50c789101871 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1267 microversion: 2.1 time: 0.097198 Oct 31 14:58:47.030644 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 148/319] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:46 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:47.070245 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:47.070878 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:47.076908 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.077640 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.078196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.079107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.079623 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.080216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.212062 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:47.220903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6e03686a-4f72-4207-b465-e1e02f5e3486 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.155137 Oct 31 14:58:47.221488 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 172/320] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:47 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:47.526102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:47.526706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:47.533428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.533944 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.534375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.535321 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.535529 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.535991 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.571666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.572150 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.572601 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.573050 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lazy-loading 'fault' on Instance uuid 707946b1-50c7-4df0-9e3a-036d755eeeea {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:58:47.643949 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:47.652506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e6d3197d-abeb-44d6-8826-5cb66a8591af tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1303 microversion: 2.1 time: 0.130208 Oct 31 14:58:47.653328 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 149/321] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:47 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:47.767968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:47.768510 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:47.774554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.775031 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.775460 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.776186 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.776629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.777047 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.874812 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-aa3648e5-f492-41f3-a681-e1466eee8bc7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf78a00-4fac-4d6c-ac21-0dee3e71c828"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:47.877528 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-aa3648e5-f492-41f3-a681-e1466eee8bc7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:47.883939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa3648e5-f492-41f3-a681-e1466eee8bc7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.884413 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa3648e5-f492-41f3-a681-e1466eee8bc7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.884847 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa3648e5-f492-41f3-a681-e1466eee8bc7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.885536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa3648e5-f492-41f3-a681-e1466eee8bc7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:47.885984 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa3648e5-f492-41f3-a681-e1466eee8bc7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:47.886405 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa3648e5-f492-41f3-a681-e1466eee8bc7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:47.905228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:47.913966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:47.915441 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:47.916925 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a0f72cea-65ee-44b0-8ad2-5de9531b5b11 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.152624 Oct 31 14:58:47.917170 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 173/322] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:47 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:48.058263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:48.061810 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:48.077464 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.078049 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.078381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.079081 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.079530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.079973 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.156743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:48.165676 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-84f5688c-59d5-4262-ba64-0e07444e1243 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1273 microversion: 2.1 time: 0.115757 Oct 31 14:58:48.166258 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 174/323] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:48 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:48.243916 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:48.244660 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:48.251542 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.252088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.252524 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.253251 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.253700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.254117 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.357943 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-aa3648e5-f492-41f3-a681-e1466eee8bc7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486840 Oct 31 14:58:48.360335 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 150/324] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 14:58:47 2022] POST /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments => generated 194 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:58:48.435284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:48.444269 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-77887c69-5e32-4d09-9f36-18d64033ee8e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.204868 Oct 31 14:58:48.444952 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 175/325] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:48 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:48.694314 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:48.695046 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:48.701750 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.702346 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.702870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.703692 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.705074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.705898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.743218 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.743736 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.744215 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.745049 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lazy-loading 'fault' on Instance uuid 707946b1-50c7-4df0-9e3a-036d755eeeea {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:58:48.791431 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1d89a64c274cefb03a68c3233cfa51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075982a0ef04a6a8edbe37fde6cb657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:48.799483 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e8c1467e-6de3-45ba-8f38-1531e3a736c4 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 200 len: 1303 microversion: 2.1 time: 0.125547 Oct 31 14:58:48.800084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 151/326] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:48 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:48.942022 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:48.942749 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:48.948699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.949247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.949681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:48.950361 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:48.950807 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:48.951220 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.082936 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:49.102534 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:49.102534 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:49.102534 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9528f6b2-3034-4580-8019-d8fb2f55f818 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.158704 Oct 31 14:58:49.102835 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 176/327] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:48 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:49.189441 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:49.190413 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:49.203883 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.204949 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.205933 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.207681 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.208443 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.208977 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.443852 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:49.452543 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d848af9e-44e5-470c-aba8-5e56ffef9201 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.267516 Oct 31 14:58:49.453535 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 152/328] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:49 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:49.467795 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:49.468646 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:49.475864 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.476347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.476771 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.477624 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.478222 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.478841 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.618498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:49.626406 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4aa6f6d7-6f56-4492-a14a-3127badf3ccf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1501 microversion: 2.1 time: 0.162894 Oct 31 14:58:49.627082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 177/329] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:49 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:49.651055 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ac9835f-129f-48a7-adce-e54f2535118f"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:49.653482 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:49.659621 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.660154 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.660618 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.661882 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.662347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.662960 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.686358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] HTTP exception thrown: Cannot 'attach_volume' instance b8e52643-da13-4beb-85c9-fd94d0330a8b while it is in vm_state rescued Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Request method failure captured: Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: POST /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b/os-volume_attachments HTTP/1.1 Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 74 Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-I0WnXqVoGMkFGjruLglgKS6_fArFbovBTxoWqr2QtwCJEYLprU_tgF4EvTk2yZ_Ect21eHEtFnbIgXByF8FVTVtCG8v209_WYKdYErkOZa0vfsIIuJNfSVDMtha-xW8HjXq9pOJI89chFU9Eyu0QEvuKNGXqm9Kcfdj--tVnG-Ne4 Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 14:58:49.688110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8bc7c0eaebf146bea1af6b4d708bf62b"}]}] Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: e6bfe2c1ba054935ae8e9fcc054faf68 Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {"volumeAttachment": {"volumeId": "4ac9835f-129f-48a7-adce-e54f2535118f"}} Oct 31 14:58:49.689580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Cannot 'attach_volume' instance b8e52643-da13-4beb-85c9-fd94d0330a8b while it is in vm_state rescued Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'server_id': 'b8e52643-da13-4beb-85c9-fd94d0330a8b', 'body': {'volumeAttachment': {'volumeId': '4ac9835f-129f-48a7-adce-e54f2535118f'}}} Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8e52643-da13-4beb-85c9-fd94d0330a8b in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:49.690358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b8e52643-da13-4beb-85c9-fd94d0330a8b while it is in vm_state rescued Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:49.691363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:49.692384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:49.692384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:49.692384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b8e52643-da13-4beb-85c9-fd94d0330a8b while it is in vm_state rescued Oct 31 14:58:49.692384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.692384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Returning 409 to user: Cannot 'attach_volume' instance b8e52643-da13-4beb-85c9-fd94d0330a8b while it is in vm_state rescued {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:49.692384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-db28f467-fe0b-412a-bc4a-667d80f9ca97 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042562 Oct 31 14:58:49.692384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 153/330] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 14:58:49 2022] POST /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 14:58:49.699152 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e16630ec-9def-47d7-a130-3c9459f7e31f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:49.699718 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e16630ec-9def-47d7-a130-3c9459f7e31f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:49.705854 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e16630ec-9def-47d7-a130-3c9459f7e31f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.706336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e16630ec-9def-47d7-a130-3c9459f7e31f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.706768 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e16630ec-9def-47d7-a130-3c9459f7e31f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.707465 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e16630ec-9def-47d7-a130-3c9459f7e31f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.707936 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e16630ec-9def-47d7-a130-3c9459f7e31f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.708954 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e16630ec-9def-47d7-a130-3c9459f7e31f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.775442 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e16630ec-9def-47d7-a130-3c9459f7e31f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b/action" status: 202 len: 0 microversion: 2.1 time: 0.079907 Oct 31 14:58:49.779098 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 178/331] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 14:58:49 2022] POST /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:58:49.784629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:49.785562 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:49.793901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.794722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.795467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.796598 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.797245 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.797886 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.824583 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:49.825763 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] [instance: 707946b1-50c7-4df0-9e3a-036d755eeeea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:49.834468 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.834951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.836019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.836884 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:49.837522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:49.838110 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:49.854659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] HTTP exception thrown: Instance 707946b1-50c7-4df0-9e3a-036d755eeeea could not be found. Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Request method failure captured: Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea HTTP/1.1 Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-J6MYWH8UjiKM84EWUaSJl9jrH1cNFNY1eyBhbeF2w3ZcMPzr8eFyNbYjp4KaNDtOPpCpwmj-fgS_s_bcTqlLp-9WUe_MuvrUkVU7whdYjn2k6fLAhoJ3ZLLWfjgW2ISZHTZIolmFNrKek2_SytRSx-HkVhA-D2V0Km-2DNgdmitys Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 4075982a0ef04a6a8edbe37fde6cb657 Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-VolumesActionsTest-1534383339 Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 14:58:49.856336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4075982a0ef04a6a8edbe37fde6cb657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4075982a0ef04a6a8edbe37fde6cb657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4075982a0ef04a6a8edbe37fde6cb657"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4075982a0ef04a6a8edbe37fde6cb657"}]}] Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-VolumesActionsTest-1534383339 Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 4075982a0ef04a6a8edbe37fde6cb657 Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-VolumesActionsTest-1534383339 Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-VolumesActionsTest-1534383339-project Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: dd1d89a64c274cefb03a68c3233cfa51 Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-VolumesActionsTest-1534383339-project Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 707946b1-50c7-4df0-9e3a-036d755eeeea could not be found. Oct 31 14:58:49.857712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '707946b1-50c7-4df0-9e3a-036d755eeeea'} Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707946b1-50c7-4df0-9e3a-036d755eeeea could not be found. Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:58:49.858563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707946b1-50c7-4df0-9e3a-036d755eeeea could not be found. Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707946b1-50c7-4df0-9e3a-036d755eeeea could not be found. Oct 31 14:58:49.859914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:58:49.861899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] Returning 404 to user: Instance 707946b1-50c7-4df0-9e3a-036d755eeeea could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:58:49.861899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3fab505b-b4c0-4631-a7dc-fdcf5043f5f3 tempest-VolumesActionsTest-1534383339 tempest-VolumesActionsTest-1534383339-project] 10.222.0.36 "GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea" status: 404 len: 111 microversion: 2.1 time: 0.037862 Oct 31 14:58:49.861899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 179/332] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:49 2022] GET /compute/v2.1/servers/707946b1-50c7-4df0-9e3a-036d755eeeea => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:58:50.122555 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.123144 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:50.129715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.130842 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.131352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.132287 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.132754 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.133179 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.154298 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:50.168480 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ed714321-8451-4934-a7c0-ea09a98b3257 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1509 microversion: 2.1 time: 0.386241 Oct 31 14:58:50.170762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 154/333] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:49 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1509 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:50.177859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-bb16bcf8-952f-4c4d-bf17-53e0ad5e8be2 req-c5df9353-ee1a-4f0e-98df-24650afb4ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c09cf8-175b-414f-a52b-dd76bdfc2b33", "tag": "73a4d6e5-35cf-49f5-89d0-0e0b00b5946e"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:50.194532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-bb16bcf8-952f-4c4d-bf17-53e0ad5e8be2 req-c5df9353-ee1a-4f0e-98df-24650afb4ef8 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.195841 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-bb16bcf8-952f-4c4d-bf17-53e0ad5e8be2 req-c5df9353-ee1a-4f0e-98df-24650afb4ef8 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.196862 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-bb16bcf8-952f-4c4d-bf17-53e0ad5e8be2 req-c5df9353-ee1a-4f0e-98df-24650afb4ef8 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.216642 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-bb16bcf8-952f-4c4d-bf17-53e0ad5e8be2 req-c5df9353-ee1a-4f0e-98df-24650afb4ef8 service nova] Creating event network-changed:73a4d6e5-35cf-49f5-89d0-0e0b00b5946e for instance 42c09cf8-175b-414f-a52b-dd76bdfc2b33 on hv-cinder-86022 Oct 31 14:58:50.224340 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-bb16bcf8-952f-4c4d-bf17-53e0ad5e8be2 req-c5df9353-ee1a-4f0e-98df-24650afb4ef8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051084 Oct 31 14:58:50.225278 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 155/334] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:50.319501 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:50.332976 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:50.336894 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:50.338556 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7de530d6-51e1-4c0f-abbd-1531789cae82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.220392 Oct 31 14:58:50.340150 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 180/335] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:50 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:58:50.477329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:50.478748 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:50.484927 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.485530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.486067 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.486883 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:50.487532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:50.488068 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:50.787774 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:50.796104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8e4fcf5a-e6d1-46f5-9be9-6c8ec7b923dd tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.324311 Oct 31 14:58:50.796667 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 156/336] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:50 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:51.192006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:51.192647 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:51.199474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:51.199988 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:51.200421 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:51.201106 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:51.201553 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:51.201972 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:51.333763 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:51.341454 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-dc296250-6446-4498-91af-fb735f1909ee tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1509 microversion: 2.1 time: 0.153377 Oct 31 14:58:51.342006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 181/337] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:51 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:51.364929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:51.365629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:51.371750 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:51.372233 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:51.372665 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:51.373346 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:51.373795 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:51.374215 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:51.501355 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:51.509351 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:51.510778 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:51.511955 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-23b6228e-211f-4256-81cb-6962d4df997b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.151575 Oct 31 14:58:51.512495 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 157/338] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:51 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:51.820046 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:51.820659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:51.826531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:51.827011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:51.827441 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:51.828149 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:51.828601 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:51.829028 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:51.955857 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:51.963603 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-fd9c13e4-bd5d-446b-9759-11a4500f0d57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.147707 Oct 31 14:58:51.964200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 182/339] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:51 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:52.365348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:52.365974 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:52.372451 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:52.372929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:52.373362 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:52.374048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:52.374495 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:52.374917 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:52.426625 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:52.446393 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=6 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:52.501744 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:52.509398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-84852a12-882f-4175-81bd-d888d67d31d8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1509 microversion: 2.1 time: 0.148234 Oct 31 14:58:52.509948 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 158/340] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:52 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:52.538097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:52.538706 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:52.545404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:52.545916 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:52.546384 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:52.547110 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:52.547616 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:52.548048 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:52.578451 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:52.683740 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:52.693348 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:52.694809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:52.696124 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0dbc8840-c289-4310-82b8-26bcd2c7dc95 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.163231 Oct 31 14:58:52.696670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 183/341] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:52 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:52.987274 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:52.987910 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:52.993987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:52.994462 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:52.994904 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:52.995599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:52.996050 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:52.996468 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:53.125436 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:53.133899 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-bc4c205d-4dbd-4d5b-9c2a-60b84303592c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.150435 Oct 31 14:58:53.134451 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 159/342] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:52 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:53.532759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:53.533407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:53.540324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:53.540891 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:53.541233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:53.541924 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:53.542372 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:53.542799 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:53.670709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:53.679910 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-74a3b1de-fc09-4248-992e-bfed212b101e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1509 microversion: 2.1 time: 0.150962 Oct 31 14:58:53.680466 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 184/343] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:53 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:53.722299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:53.722908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:53.730076 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:53.730580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:53.731002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:53.731712 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:53.732156 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:53.732567 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:53.867828 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:53.875909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:53.877348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:53.878502 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-cc705e73-4cd8-4f2c-9ada-45bfe07bf2ed tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.160186 Oct 31 14:58:53.879355 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 160/344] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:53 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:54.156503 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:54.157113 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:54.163695 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:54.164172 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:54.164598 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:54.165294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:54.165720 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:54.166135 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:54.180573 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:54.300629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:54.308325 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-712e18c2-0463-4652-96f7-1040a7d79f47 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.155629 Oct 31 14:58:54.308917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 185/345] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:54 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:54.703433 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:54.704487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:54.711980 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:54.713443 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:54.714051 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:54.715158 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:54.715791 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:54.716217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:54.905260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:54.905879 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:54.913542 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:54.914027 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:54.914460 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:54.915925 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:54.917058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:54.917686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:55.083710 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:55.093148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:55.094780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:55.096237 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f933a955-8ff7-4f5b-8ef6-a8e867bf7613 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.195659 Oct 31 14:58:55.097284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 186/346] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:54 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:55.154504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:55.156772 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:55.173634 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e85730ee-5d3e-4dc1-b62a-b2a1f8272c05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1509 microversion: 2.1 time: 0.473176 Oct 31 14:58:55.175179 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 161/347] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:54 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1509 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:55.331875 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:55.332429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:55.339659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:55.340139 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:55.340729 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:55.341598 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:55.342043 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:55.342464 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:55.516020 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:55.526247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0d83e260-c03f-4bf5-b2a2-ea350d58728e tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.198575 Oct 31 14:58:55.526816 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 187/348] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:55 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:56.128757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:56.129779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:56.141630 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:56.142340 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:56.142836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:56.143869 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:56.144521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:56.145297 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:56.198531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:56.202126 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:56.211191 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:56.211995 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:56.212632 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:56.213352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:56.213817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:56.214270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:56.543049 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:56.558423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-27f86441-d67a-4c20-bf1b-690c2f53b477 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1509 microversion: 2.1 time: 0.363407 Oct 31 14:58:56.572762 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 188/349] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:56 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:56.598036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:56.607641 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:56.609657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:56.611212 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c01c5154-c4ec-4feb-b25c-e58ac7fc68ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.488692 Oct 31 14:58:56.612124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 162/350] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:56 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:56.634185 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:56.638847 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:56.660715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:56.664292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:56.664774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:56.665644 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:56.665982 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:56.666408 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:56.869992 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:56.889862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-48e195dd-bcc3-479c-9594-fe3ca9e9ea4d tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.315566 Oct 31 14:58:56.890456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 189/351] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:56 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:57.586391 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:57.587296 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:57.594064 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:57.594735 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:57.595331 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:57.596217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:57.596810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:57.597376 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:57.641130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:57.643439 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:57.657158 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:57.661059 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:57.661635 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:57.662629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:57.664504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:57.668561 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:57.829694 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:57.848073 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7aabee2e-2659-469d-8581-581bf0627bd9 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1515 microversion: 2.1 time: 0.266113 Oct 31 14:58:57.853103 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 163/352] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:57 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:57.917299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:57.917907 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:57.923896 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:57.924393 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:57.924815 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:57.925511 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:57.925962 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:57.926382 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:58.045666 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:58.058914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:58.061343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:58.063135 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9daf7332-af11-4e91-9462-48e7dbc6620d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1746 microversion: 2.20 time: 0.426103 Oct 31 14:58:58.065229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 190/353] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:57 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1746 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:58:58.071947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-13d24de5-be6d-4e39-9c9a-44f68a9647e0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:58.080607 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-13d24de5-be6d-4e39-9c9a-44f68a9647e0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:58.082268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-13d24de5-be6d-4e39-9c9a-44f68a9647e0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:58.083223 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-13d24de5-be6d-4e39-9c9a-44f68a9647e0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:58.150136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-13d24de5-be6d-4e39-9c9a-44f68a9647e0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Going to try to stop instance {{(pid=134339) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 14:58:58.185012 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:58.221325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ed5b81eb-74d2-48b2-b9ea-a329d7e7f2c1 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.299792 Oct 31 14:58:58.221325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 164/354] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:57 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:58.302524 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-13d24de5-be6d-4e39-9c9a-44f68a9647e0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/action" status: 202 len: 0 microversion: 2.1 time: 0.234652 Oct 31 14:58:58.303686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 191/355] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 14:58:58 2022] POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:58:58.312397 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:58.313418 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:58.320224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:58.323376 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:58.324124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:58.325103 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:58.326678 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:58.327481 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:58.328357 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:58.520422 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:58.533997 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d0412998-27c1-4062-8b13-7a8213524513 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1721 microversion: 2.1 time: 0.225446 Oct 31 14:58:58.534995 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 165/356] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:58 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:58:58.718744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-14c3b50b-65ae-48f6-aab4-ad505a623599 req-4ccb6231-7183-4ffd-ba88-7a718e03e0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c09cf8-175b-414f-a52b-dd76bdfc2b33", "name": "network-vif-plugged", "status": "completed", "tag": "73a4d6e5-35cf-49f5-89d0-0e0b00b5946e"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:58.730541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-14c3b50b-65ae-48f6-aab4-ad505a623599 req-4ccb6231-7183-4ffd-ba88-7a718e03e0d7 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:58.731217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-14c3b50b-65ae-48f6-aab4-ad505a623599 req-4ccb6231-7183-4ffd-ba88-7a718e03e0d7 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:58.731859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-14c3b50b-65ae-48f6-aab4-ad505a623599 req-4ccb6231-7183-4ffd-ba88-7a718e03e0d7 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:58.744517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-14c3b50b-65ae-48f6-aab4-ad505a623599 req-4ccb6231-7183-4ffd-ba88-7a718e03e0d7 service nova] Creating event network-vif-plugged:73a4d6e5-35cf-49f5-89d0-0e0b00b5946e for instance 42c09cf8-175b-414f-a52b-dd76bdfc2b33 on hv-cinder-86022 Oct 31 14:58:58.750062 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-14c3b50b-65ae-48f6-aab4-ad505a623599 req-4ccb6231-7183-4ffd-ba88-7a718e03e0d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035736 Oct 31 14:58:58.751188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 192/357] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:58:59.102756 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:59.104132 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:59.110368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:59.110917 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:59.111578 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:59.115746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:59.117687 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:59.119014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:59.246865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:59.247600 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:59.253739 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:59.254218 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:59.254650 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:59.255429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:59.255907 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:59.256327 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:59.280048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:59.291719 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:59.293438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:59.294807 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8f2fd76e-302a-4adb-8f97-260c15d286ff tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1746 microversion: 2.20 time: 0.204594 Oct 31 14:58:59.311765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 166/358] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:58:59 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1746 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:58:59.427275 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:59.443699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c3e2250e-b8dc-4f4b-b0bc-744f3cd3d6e7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.200306 Oct 31 14:58:59.444767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 193/359] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:59 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:58:59.563520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-13eabe95-68f6-45e4-b66b-8511a77589a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'create', calling method: .version_select at 0x7f6c71003a60>, body: {"keypair": {"name": "tempest-keypair-412097319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMs9i/zsnwwrCJ7OnUfvfXoXmntM2rj77u5M4045QKeMx9M3v66a+qkUUZ5G/BJNW2ylgeCCXEOUvwjnX4EmTxt+Rxg/1HYJs7tpnY1XDXPRNCZeLCEjcCZN2CHkkItROA=="}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:58:59.564224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:58:59.565249 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:58:59.572697 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:59.573449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:59.574043 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:59.574920 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:58:59.575753 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:58:59.576317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:58:59.581859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-13eabe95-68f6-45e4-b66b-8511a77589a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Getting quotas for project 8bc7c0eaebf146bea1af6b4d708bf62b. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:58:59.587129 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:59.589523 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-13eabe95-68f6-45e4-b66b-8511a77589a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Getting quotas for user e6bfe2c1ba054935ae8e9fcc054faf68 and project 8bc7c0eaebf146bea1af6b4d708bf62b. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:58:59.622430 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-13eabe95-68f6-45e4-b66b-8511a77589a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062613 Oct 31 14:58:59.628962 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 194/360] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 14:58:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:58:59.789409 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:58:59.801863 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e9b6f79d-191a-4a02-9dee-8e47e8b4a758 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1721 microversion: 2.1 time: 0.242410 Oct 31 14:58:59.803887 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 167/361] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:58:59 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:00.324011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:00.325744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:00.338063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:00.339500 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:00.340293 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:00.341836 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:00.342522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:00.343368 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:00.472825 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:00.475699 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:00.483284 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:00.484065 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:00.484918 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:00.485918 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:00.486594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:00.487322 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:00.567118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:00.585383 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:00.590098 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:00.607895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-bbe65894-85b7-425a-b208-0aca9f24393b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1741 microversion: 2.20 time: 0.290000 Oct 31 14:59:00.611066 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 195/362] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:00 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:00.772591 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-64590fcb-1f70-4a4b-8c8c-66296e6283b6 req-1169b747-ed42-4821-9b49-429a64e04857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214568bd-3ebf-4f91-8153-d60959d49119", "name": "network-vif-plugged", "status": "completed", "tag": "6951bd8b-ac72-4ceb-9344-47d91749e055"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:00.773564 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:00.787520 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f52f5e06-9fba-4517-a589-7a015ed41e96 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1315 microversion: 2.1 time: 0.319757 Oct 31 14:59:00.788442 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 168/363] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:00 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:00.790791 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-64590fcb-1f70-4a4b-8c8c-66296e6283b6 req-1169b747-ed42-4821-9b49-429a64e04857 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:00.793883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-64590fcb-1f70-4a4b-8c8c-66296e6283b6 req-1169b747-ed42-4821-9b49-429a64e04857 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:00.794336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-64590fcb-1f70-4a4b-8c8c-66296e6283b6 req-1169b747-ed42-4821-9b49-429a64e04857 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:00.819633 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-64590fcb-1f70-4a4b-8c8c-66296e6283b6 req-1169b747-ed42-4821-9b49-429a64e04857 service nova] Creating event network-vif-plugged:6951bd8b-ac72-4ceb-9344-47d91749e055 for instance 214568bd-3ebf-4f91-8153-d60959d49119 on hv-cinder-86022 Oct 31 14:59:00.825839 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-64590fcb-1f70-4a4b-8c8c-66296e6283b6 req-1169b747-ed42-4821-9b49-429a64e04857 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057426 Oct 31 14:59:00.826980 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 196/364] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 14:59:00.828699 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:00.829684 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:00.839590 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:00.841158 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:00.841905 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:00.843772 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:00.844241 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:00.844723 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:01.081319 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:01.093795 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4155b63a-cd5b-4537-a2f0-e19e5a3000f7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1721 microversion: 2.1 time: 0.270868 Oct 31 14:59:01.096790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 169/365] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:00 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:01.640663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:01.641650 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:01.742779 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:01.743883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:01.744660 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:01.746338 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:01.747080 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:01.747808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:01.811269 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:01.812944 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:01.838893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:01.841868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:01.842544 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:01.844478 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:01.845320 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:01.846759 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:01.960309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:01.970513 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:01.972500 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:01.974125 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ef116dd5-a63e-4120-857f-b6a1ae94e78a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1741 microversion: 2.20 time: 0.340170 Oct 31 14:59:01.975419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 197/366] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:01 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1741 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:02.130081 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:02.136695 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:02.166780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:02.167293 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:02.167750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:02.168463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:02.171596 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:02.172107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:02.190633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:02.199817 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ee100123-e006-4995-b989-f5e04a2b3c8c tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1465 microversion: 2.1 time: 0.392669 Oct 31 14:59:02.201036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 170/367] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:01 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1465 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:02.267395 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:02.267923 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:02.275039 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:02.287890 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:02.288888 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:02.290100 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:02.290725 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:02.291362 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:02.342026 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 14:59:02.499536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c927e7e0-9a65-465d-af22-4088d9bda4dc tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "DELETE /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 204 len: 0 microversion: 2.1 time: 0.237808 Oct 31 14:59:02.500334 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 171/368] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 14:59:02 2022] DELETE /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 14:59:02.540007 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1784670309", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03bb4962-9fda-452b-81f0-eb5044fdf378"}], "security_groups": [{"name": "tempest-securitygroup--997002451"}], "key_name": "tempest-keypair-412097319", "user_data": "}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:02.591101 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:02.610984 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d530ca35-74f0-4f38-93ed-24269ac44247 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1721 microversion: 2.1 time: 0.492350 Oct 31 14:59:02.629722 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 198/369] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:02 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1721 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:02.654784 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:02.657940 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:02.677092 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:02.685115 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:02.689522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:02.691111 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:02.693024 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:02.696458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:03.003753 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:03.016807 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-258b70a6-b210-4c15-a59a-5498d0bd3fa0 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1471 microversion: 2.1 time: 0.379438 Oct 31 14:59:03.017303 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 199/370] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:02 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1471 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:03.022614 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:03.023244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:03.029973 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:03.030471 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:03.030911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:03.031645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:03.032107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:03.032534 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:03.278812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:03.298541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:03.312754 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:03.314613 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-97ffa682-4ba4-4b91-a249-77e68e933edd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1741 microversion: 2.20 time: 0.296339 Oct 31 14:59:03.315398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 200/371] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:03 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1741 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:03.648912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:03.649954 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:03.657167 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:03.658425 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:03.659090 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:03.660056 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:03.660783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:03.661931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:03.846610 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:03.857321 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-888f4a09-9b5b-46a5-b017-cc989af6282a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1721 microversion: 2.1 time: 0.212360 Oct 31 14:59:03.871587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 201/372] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:03 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:04.050476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:04.051286 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:04.067034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:04.068546 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:04.070585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:04.079378 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:04.080908 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:04.081557 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:04.350531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:04.382058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-833ef818-586a-47b7-beeb-4b0f4a4768df tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1471 microversion: 2.1 time: 0.336324 Oct 31 14:59:04.385117 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 202/373] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:04 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1471 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:04.435898 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:04.437189 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:04.444985 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:04.445982 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:04.446842 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:04.447947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:04.448781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:04.449535 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:04.475382 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:04.687589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:04.699108 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:04.700626 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:04.701808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-240d1515-f965-4577-b6f2-8f30b401fd0f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1741 microversion: 2.20 time: 0.307073 Oct 31 14:59:04.711587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 203/374] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:04 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1741 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:04.886159 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:04.887164 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:04.907301 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:04.908437 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:04.909093 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:04.910422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:04.910896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:04.912167 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:05.156997 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:05.166791 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-336d6dbc-63f2-454d-9abf-f7bb40636f6b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1721 microversion: 2.1 time: 0.284797 Oct 31 14:59:05.183488 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 204/375] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:04 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:05.441605 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:05.441605 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:05.451747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:05.452266 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:05.452759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:05.458310 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:05.458958 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:05.459859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:05.689769 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:05.703687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8c689477-1e54-4273-adf9-9131995c77d7 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1471 microversion: 2.1 time: 0.266582 Oct 31 14:59:05.705574 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 205/376] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:05 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:05.730781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:05.731402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:05.741270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:05.741773 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:05.742201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:05.742903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:05.743637 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:05.752012 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:06.038815 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:06.049058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:06.050799 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:06.052419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-16df2bbc-4c9d-4810-9d84-e05ee0cda6bd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1741 microversion: 2.20 time: 0.325516 Oct 31 14:59:06.067578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 206/377] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:05 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:06.067578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-b6899152-5744-4754-8670-7a172a376e8d req-383918a6-7ffd-44d2-a4b2-2af5d57dcd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c09cf8-175b-414f-a52b-dd76bdfc2b33", "name": "network-vif-deleted", "tag": "73a4d6e5-35cf-49f5-89d0-0e0b00b5946e"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:06.072216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b6899152-5744-4754-8670-7a172a376e8d req-383918a6-7ffd-44d2-a4b2-2af5d57dcd43 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:06.072216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b6899152-5744-4754-8670-7a172a376e8d req-383918a6-7ffd-44d2-a4b2-2af5d57dcd43 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:06.072216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b6899152-5744-4754-8670-7a172a376e8d req-383918a6-7ffd-44d2-a4b2-2af5d57dcd43 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:06.106718 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-b6899152-5744-4754-8670-7a172a376e8d req-383918a6-7ffd-44d2-a4b2-2af5d57dcd43 service nova] Creating event network-vif-deleted:73a4d6e5-35cf-49f5-89d0-0e0b00b5946e for instance 42c09cf8-175b-414f-a52b-dd76bdfc2b33 on hv-cinder-86022 Oct 31 14:59:06.125015 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-b6899152-5744-4754-8670-7a172a376e8d req-383918a6-7ffd-44d2-a4b2-2af5d57dcd43 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070242 Oct 31 14:59:06.125943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 207/378] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:06.191249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:06.192044 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:06.210604 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:06.211072 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:06.211215 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:06.212094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:06.212637 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:06.213173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:06.556089 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:06.565675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-94dce004-892f-4d02-a98b-3a29a2c69762 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1721 microversion: 2.1 time: 0.378729 Oct 31 14:59:06.566450 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 208/379] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:06 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:06.571913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1ba1b16b-0906-4a77-8723-d518a41ddb7a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: .version_select at 0x7f6c71023040>, body: {"keypair": {"name": "tempest-keypair-595097263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRlZZScnqz1YA01KmMKV+Rhn1KCazFiyvFahspYsQUgKhfpoPQr+w5XhJsA1DikgdMsFjS1ae69n+5UycM5YzeFvhRZPEeBn7TvBO56RuViXGJ2xN0naSkyVPGDJFusNg=="}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:06.599831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-1ba1b16b-0906-4a77-8723-d518a41ddb7a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for project f629aa044ca845069237ecb8d889284e. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:59:06.605361 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-1ba1b16b-0906-4a77-8723-d518a41ddb7a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for user cdcbcb2ed9e44dbe8444e531fc1eb707 and project f629aa044ca845069237ecb8d889284e. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:59:06.649869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1ba1b16b-0906-4a77-8723-d518a41ddb7a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081743 Oct 31 14:59:06.651018 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 209/380] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 14:59:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:06.728714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:06.729375 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:06.748911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:06.751001 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:06.751483 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:06.755431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:06.755951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:06.756400 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:06.870703 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:06.872346 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:06.872860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:06.873350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lazy-loading 'fault' on Instance uuid 42c09cf8-175b-414f-a52b-dd76bdfc2b33 {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:59:07.010170 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da2ba5ff4a449ba678db76180c4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d647ac8f50049dab664e81a70e106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:07.028759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d9f2cd5c-4b37-4a45-82d9-366d000c9f57 tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 200 len: 1305 microversion: 2.1 time: 0.304995 Oct 31 14:59:07.029383 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 210/381] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:06 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 1305 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:07.079221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:07.080192 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:07.089523 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:07.089523 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:07.089880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:07.090543 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:07.091007 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:07.091435 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:07.373496 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:07.391250 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:07.393458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:07.394748 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b3ba755a-9853-432a-bf5c-d1658878e99d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1741 microversion: 2.20 time: 0.319671 Oct 31 14:59:07.424778 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 211/382] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:07 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1741 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:07.594034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:07.594935 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:07.607500 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:07.611745 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:07.612701 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:07.615825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:07.616488 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:07.617415 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:07.968789 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:07.983427 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8c30ce08-7301-4350-be53-d2fd9a329617 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1721 microversion: 2.1 time: 0.393366 Oct 31 14:59:07.986062 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 212/383] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:07 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1721 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:08.056621 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:08.057425 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] [instance: 42c09cf8-175b-414f-a52b-dd76bdfc2b33] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:08.065004 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:08.065663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:08.066172 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:08.066968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:08.068093 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:08.068589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:08.086653 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] HTTP exception thrown: Instance 42c09cf8-175b-414f-a52b-dd76bdfc2b33 could not be found. Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Request method failure captured: Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 HTTP/1.1 Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-KgeXtIVTs-dbl9NOKFSf1WEj-e0kUWCPkgqWUK46VUHQBvqg4L-7AgH8ZXXlRHIgSVvY-dwFPO_Snv54Dn0xZDowt62fS5xe2OktsKm9wxEXd2HOCGZP40OGFVVdXoQ1KiVmyVYdBEcs3CvYjNwaoToz2epurRPiDxl4mTDUSo274 Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 0d647ac8f50049dab664e81a70e106ca Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-VolumesNegativeTest-246696028 Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 14:59:08.091812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d647ac8f50049dab664e81a70e106ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d647ac8f50049dab664e81a70e106ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d647ac8f50049dab664e81a70e106ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d647ac8f50049dab664e81a70e106ca"}]}] Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-VolumesNegativeTest-246696028 Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 0d647ac8f50049dab664e81a70e106ca Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-VolumesNegativeTest-246696028 Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-VolumesNegativeTest-246696028-project Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: d2da2ba5ff4a449ba678db76180c4cbd Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-VolumesNegativeTest-246696028-project Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 42c09cf8-175b-414f-a52b-dd76bdfc2b33 could not be found. Oct 31 14:59:08.093401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '42c09cf8-175b-414f-a52b-dd76bdfc2b33'} Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c09cf8-175b-414f-a52b-dd76bdfc2b33 could not be found. Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 14:59:08.094395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c09cf8-175b-414f-a52b-dd76bdfc2b33 could not be found. Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c09cf8-175b-414f-a52b-dd76bdfc2b33 could not be found. Oct 31 14:59:08.095866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 14:59:08.097177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] Returning 404 to user: Instance 42c09cf8-175b-414f-a52b-dd76bdfc2b33 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 14:59:08.097177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6bdd0fc4-cfb0-423b-92b1-88f1d66bc87f tempest-VolumesNegativeTest-246696028 tempest-VolumesNegativeTest-246696028-project] 10.222.0.36 "GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33" status: 404 len: 111 microversion: 2.1 time: 0.044068 Oct 31 14:59:08.100239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 213/384] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:08 2022] GET /compute/v2.1/servers/42c09cf8-175b-414f-a52b-dd76bdfc2b33 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 14:59:08.424165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:08.425326 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:08.442406 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:08.443338 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:08.444044 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:08.445236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:08.445953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:08.446599 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:08.670770 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:08.684969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:08.687277 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:08.689251 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5d77310b-9e9e-4291-9710-bf9ceb288158 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1741 microversion: 2.20 time: 0.269037 Oct 31 14:59:08.690245 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 214/385] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:08 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:09.012599 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:09.012599 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:09.023628 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:09.023628 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:09.023628 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:09.024033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:09.025304 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:09.025304 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:09.241682 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:09.259608 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f2550306-c809-437b-8305-49cc82d286b9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1721 microversion: 2.1 time: 0.251301 Oct 31 14:59:09.288870 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 215/386] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:09 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:09.300550 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2128573274", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "344848ef-d9a5-4f9a-8ddf-c96c364ed358"}], "security_groups": [{"name": "tempest-securitygroup--1393597680"}], "key_name": "tempest-keypair-595097263", "user_data": "}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:12.448479 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:12.583862 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:13.261987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] validate_networks() for [('03bb4962-9fda-452b-81f0-eb5044fdf378', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:59:13.706162 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] validate_networks() for [('344848ef-d9a5-4f9a-8ddf-c96c364ed358', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 14:59:13.866256 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:59:13.866865 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:59:13.867224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:59:13.867659 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:59:13.868085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:59:13.879661 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:13.880465 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:13.880577 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:13.881415 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:13.881881 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:13.882312 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:13.914917 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Getting quotas for project 8bc7c0eaebf146bea1af6b4d708bf62b. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:59:13.930176 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Getting quotas for user e6bfe2c1ba054935ae8e9fcc054faf68 and project 8bc7c0eaebf146bea1af6b4d708bf62b. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:59:13.952258 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:59:13.965000 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:59:14.056847 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a2120edf-d486-4ea1-bc16-c34d5f11c78f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 11.552041 Oct 31 14:59:14.057492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 172/387] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:59:02 2022] POST /compute/v2.1/servers => generated 408 bytes in 11557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:59:14.068718 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:14.069568 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:14.080356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.081094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.081910 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.083517 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.084189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.084796 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.341054 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:14.352060 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:14.353779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:14.355430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ded4c047-1b29-4edc-a6a5-2ccee001b1ca tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1723 microversion: 2.20 time: 0.290540 Oct 31 14:59:14.356771 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 173/388] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:14 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:14.362225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:14.363198 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:14.380209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.380836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.381235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.382996 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.383443 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.384293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.577357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 14:59:14.577781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 14:59:14.578610 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 14:59:14.579119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 14:59:14.579824 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 14:59:14.595329 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.596140 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.596811 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.597745 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.599831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.600462 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.619986 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for project f629aa044ca845069237ecb8d889284e. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 14:59:14.624633 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for user cdcbcb2ed9e44dbe8444e531fc1eb707 and project f629aa044ca845069237ecb8d889284e. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 14:59:14.626935 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:14.639144 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 14:59:14.640324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f733b745-5739-4089-8f58-01bf76de633a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1698 microversion: 2.1 time: 0.281387 Oct 31 14:59:14.640911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 174/389] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:14 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1698 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:14.642952 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 14:59:14.648812 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:14.649472 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:14.668675 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.676810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.677706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.679419 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.679961 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.680516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.746754 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0cf50d12-5f2e-44f7-bf2b-314c5b831faf tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.453455 Oct 31 14:59:14.747495 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 216/390] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 14:59:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 5455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 14:59:14.752021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b7fddea1-1580-4d52-888c-14f6e798ac4a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:14.760663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b7fddea1-1580-4d52-888c-14f6e798ac4a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.761379 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b7fddea1-1580-4d52-888c-14f6e798ac4a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.762182 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b7fddea1-1580-4d52-888c-14f6e798ac4a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.782305 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:14.790362 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b7fddea1-1580-4d52-888c-14f6e798ac4a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Going to try to start instance {{(pid=134339) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 14:59:14.791939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-fa7b4d24-ee7a-472d-9405-b06feba981c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1249 microversion: 2.1 time: 0.149001 Oct 31 14:59:14.803575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 175/391] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:14 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1249 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:14.809513 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c5faaf38-0a49-4394-a6ed-0299756df03d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:14.809513 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c5faaf38-0a49-4394-a6ed-0299756df03d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:14.851344 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b7fddea1-1580-4d52-888c-14f6e798ac4a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/action" status: 202 len: 0 microversion: 2.1 time: 0.102607 Oct 31 14:59:14.852353 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 217/392] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 14:59:14 2022] POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 14:59:14.861699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:14.862844 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:14.871886 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.872841 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.873759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.874818 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:14.875584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:14.876668 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:14.976860 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c5faaf38-0a49-4394-a6ed-0299756df03d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:14.996756 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c5faaf38-0a49-4394-a6ed-0299756df03d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1241 microversion: 2.1 time: 0.202676 Oct 31 14:59:15.015580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 176/393] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:14 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1241 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:15.126838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:15.140213 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a947f841-c32e-42c6-931e-706f1db8ea27 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1707 microversion: 2.1 time: 0.282722 Oct 31 14:59:15.141193 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 218/394] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:14 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1707 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:15.386349 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:15.387019 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:15.397102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:15.397772 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:15.398257 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:15.399039 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:15.399485 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:15.399981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:15.565903 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:15.576068 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:15.577589 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:15.578817 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ef3a5853-95c8-4de2-b25c-5d592c76ec8b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1723 microversion: 2.20 time: 0.200751 Oct 31 14:59:15.580148 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 177/395] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:15 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:15.819485 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:15.820185 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:15.826947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:15.827481 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:15.828039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:15.828727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:15.829180 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:15.829872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:15.918575 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:15.929943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9d924f5f-d233-47d1-a14c-ca7c9212b69f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1297 microversion: 2.1 time: 0.115654 Oct 31 14:59:15.930559 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 219/396] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:15 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1297 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:16.030197 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:16.031032 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:16.037780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.038324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.038979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.039806 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.040254 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.040669 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.111370 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:16.119224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6264fe1e-a380-483e-a497-b8d91a31cba2 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1245 microversion: 2.1 time: 0.093674 Oct 31 14:59:16.120346 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 178/397] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:16 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:16.165822 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:16.166452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:16.172319 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.172791 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.173216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.173888 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.174329 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.174741 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.312701 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:16.323959 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ec86c8f8-b181-46a0-847c-f9b16c0ca393 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1707 microversion: 2.1 time: 0.161924 Oct 31 14:59:16.324618 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 220/398] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:16 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1707 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:16.585703 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-bc9b948a-4043-4380-a052-5c54bf98d040 req-cdf9ad1c-4482-4faf-884d-1bfa285d07b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214568bd-3ebf-4f91-8153-d60959d49119", "name": "network-vif-unplugged", "status": "completed", "tag": "6951bd8b-ac72-4ceb-9344-47d91749e055"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:16.596661 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-bc9b948a-4043-4380-a052-5c54bf98d040 req-cdf9ad1c-4482-4faf-884d-1bfa285d07b4 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.597136 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-bc9b948a-4043-4380-a052-5c54bf98d040 req-cdf9ad1c-4482-4faf-884d-1bfa285d07b4 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.603979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-bc9b948a-4043-4380-a052-5c54bf98d040 req-cdf9ad1c-4482-4faf-884d-1bfa285d07b4 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.604849 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:16.605541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:16.611707 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.612392 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.612979 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.614630 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.615628 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.616271 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.619968 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-bc9b948a-4043-4380-a052-5c54bf98d040 req-cdf9ad1c-4482-4faf-884d-1bfa285d07b4 service nova] Creating event network-vif-unplugged:6951bd8b-ac72-4ceb-9344-47d91749e055 for instance 214568bd-3ebf-4f91-8153-d60959d49119 on hv-cinder-86022 Oct 31 14:59:16.627007 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-bc9b948a-4043-4380-a052-5c54bf98d040 req-cdf9ad1c-4482-4faf-884d-1bfa285d07b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045067 Oct 31 14:59:16.627643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 179/399] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:16.762715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:16.765104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:16.772079 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:16.773505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:16.774650 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-14120407-e952-4eff-8a1e-cf799699ef53 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1723 microversion: 2.20 time: 0.173815 Oct 31 14:59:16.775207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 221/400] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:16 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:16.953830 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:16.954806 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:16.961519 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.961997 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.962655 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:16.963345 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:16.963816 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:16.964233 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:17.029585 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:17.038369 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-aab83bfc-a782-411b-b277-73a88ab6600e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1297 microversion: 2.1 time: 0.088779 Oct 31 14:59:17.039277 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 180/401] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:16 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:17.142737 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:17.143669 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:17.152104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:17.152611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:17.153286 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:17.153861 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:17.154318 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:17.157463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:17.263080 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:17.285669 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a802fdec-8674-41b7-98f8-be95a1591cda tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1245 microversion: 2.1 time: 0.144343 Oct 31 14:59:17.299580 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 222/402] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:17 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1245 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:17.347459 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:17.348286 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:17.360510 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:17.361154 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:17.361689 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:17.362526 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:17.363080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:17.364536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:17.802167 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:17.803124 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:17.812733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:17.813554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:17.814382 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:17.815358 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:17.816066 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:17.816747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:17.947113 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:17.959217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-58781d53-2383-4dc3-8a78-bf0ea3ab42d0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1707 microversion: 2.1 time: 0.615567 Oct 31 14:59:17.971822 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 181/403] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:17 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1707 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:18.019194 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:18.028595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:18.030035 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:18.031204 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-55dafea5-2001-47da-8bc4-71385ba451a9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1726 microversion: 2.20 time: 0.233845 Oct 31 14:59:18.031776 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 223/404] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:17 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1726 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:18.056942 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-23f94271-ec74-46c9-a5cb-4d5d6434e32d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d40ade40-9ab0-45b7-b162-3d0d5747251e"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:18.059516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-23f94271-ec74-46c9-a5cb-4d5d6434e32d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:18.060520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:18.061152 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:18.068209 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:18.068697 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:18.069322 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:18.070335 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:18.070947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:18.071638 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:18.071761 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23f94271-ec74-46c9-a5cb-4d5d6434e32d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:18.072229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23f94271-ec74-46c9-a5cb-4d5d6434e32d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:18.072986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23f94271-ec74-46c9-a5cb-4d5d6434e32d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:18.073872 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23f94271-ec74-46c9-a5cb-4d5d6434e32d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:18.074692 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23f94271-ec74-46c9-a5cb-4d5d6434e32d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:18.075272 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23f94271-ec74-46c9-a5cb-4d5d6434e32d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:18.159664 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:18.179666 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b2a81418-05c1-4ef4-aad3-2d432cf2d472 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1303 microversion: 2.1 time: 0.122724 Oct 31 14:59:18.180480 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 224/405] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:18 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:18.313821 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:18.314431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:18.325353 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:18.326862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:18.328285 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:18.330261 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:18.332887 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:18.335537 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:18.621208 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-23f94271-ec74-46c9-a5cb-4d5d6434e32d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.568069 Oct 31 14:59:18.622398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 182/406] 10.222.0.36 () {62 vars in 1364 bytes} [Mon Oct 31 14:59:18 2022] POST /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments => generated 188 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 14:59:18.639508 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:18.656014 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-97c9f356-0fcd-48eb-ae31-a2a55c1adea8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1301 microversion: 2.1 time: 0.346085 Oct 31 14:59:18.660387 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 225/407] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:18 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1301 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:18.800480 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:18.804365 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:18.826510 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:18.828302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:18.829732 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:18.834197 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:18.835152 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:18.838845 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:18.942724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134338) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 14:59:18.990713 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:18.998282 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:19.012524 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.016343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.016822 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.018108 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.018588 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.019021 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.039803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6ee0e086-21cf-4bea-88d2-afed83deebdd tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/action" status: 202 len: 0 microversion: 2.20 time: 0.246337 Oct 31 14:59:19.041294 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 183/408] 10.222.0.36 () {62 vars in 1319 bytes} [Mon Oct 31 14:59:18 2022] POST /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 14:59:19.050400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:19.052342 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:19.067291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.067959 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.068235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.070821 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.071287 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.071756 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.229802 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:19.243643 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a55d9135-3410-476c-8734-a743ebeb1e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1707 microversion: 2.1 time: 0.263684 Oct 31 14:59:19.245111 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 226/409] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:18 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1707 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:19.260888 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:19.261703 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:19.271248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:19.273311 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.273979 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.274622 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.276065 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.276715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.277446 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.438337 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:19.450551 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:19.452089 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:19.453283 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4341cb08-e08f-44ba-8052-91c953698857 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1812 microversion: 2.20 time: 0.407833 Oct 31 14:59:19.459213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 184/410] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:19 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1812 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:19.504333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:19.513742 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-762aec3e-3d97-4573-8634-41cb43803fe8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.266528 Oct 31 14:59:19.514327 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 227/411] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:19 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:19.689119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:19.689916 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:19.700688 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.703545 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.704836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.707512 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:19.709143 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:19.711277 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:19.824477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:19.833831 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e8c13d2f-1bb1-4746-afba-d0a756591871 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1299 microversion: 2.1 time: 0.149953 Oct 31 14:59:19.843612 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 185/412] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:19 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:20.274441 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:20.276109 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:20.288819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.289725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.290294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.291722 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.292476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.293116 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.485811 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:20.486415 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:20.496797 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.497288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.497719 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.498428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.498878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.499295 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.505085 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:20.514341 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-06352290-793b-43ce-b8e5-39a7f1771199 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1711 microversion: 2.1 time: 0.243587 Oct 31 14:59:20.518463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 228/413] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:20 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1711 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:20.538956 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:20.539715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:20.555783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.556474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.557095 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.557962 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.558942 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.560136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.744477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:20.752888 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-01f3d969-5c47-475f-a627-4c3f1bfb1ca8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.218909 Oct 31 14:59:20.753476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 229/414] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:20 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:20.857045 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:20.858101 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:20.864815 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.865509 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.866242 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.867169 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:20.867801 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:20.868297 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:20.917919 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:20.928708 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:20.930196 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:20.931375 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d16787ee-43f4-46f2-9f0e-c3963c26b9b1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1752 microversion: 2.20 time: 0.449451 Oct 31 14:59:20.931978 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 186/415] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:20 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1752 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:21.034328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:21.045347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-210010cc-387d-4c57-af2b-fc76e85a0fe8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.191983 Oct 31 14:59:21.046295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 230/416] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:20 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:21.105921 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-2dede5b9-6b51-49e3-b9e6-48b9af68c5cd req-1f630852-bf17-48b1-84dd-262f16b56418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764f83d2-ab35-4b21-a738-a7f366fddf0e", "tag": "eca3597d-1f0c-4411-bf26-b163a2db64fc"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:21.125202 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-2dede5b9-6b51-49e3-b9e6-48b9af68c5cd req-1f630852-bf17-48b1-84dd-262f16b56418 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:21.125678 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-2dede5b9-6b51-49e3-b9e6-48b9af68c5cd req-1f630852-bf17-48b1-84dd-262f16b56418 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:21.126306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-2dede5b9-6b51-49e3-b9e6-48b9af68c5cd req-1f630852-bf17-48b1-84dd-262f16b56418 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:21.130696 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:21.138440 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-2dede5b9-6b51-49e3-b9e6-48b9af68c5cd req-1f630852-bf17-48b1-84dd-262f16b56418 service nova] Creating event network-changed:eca3597d-1f0c-4411-bf26-b163a2db64fc for instance 764f83d2-ab35-4b21-a738-a7f366fddf0e on hv-cinder-86022 Oct 31 14:59:21.143324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-2dede5b9-6b51-49e3-b9e6-48b9af68c5cd req-1f630852-bf17-48b1-84dd-262f16b56418 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041081 Oct 31 14:59:21.143951 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 187/417] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:21.778254 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:21.780381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:21.788522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:21.790805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:21.791405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:21.792392 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:21.793051 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:21.793906 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:21.948092 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:21.958321 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-45ab56b2-d5e9-4d5f-98aa-5c82a6050376 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.185394 Oct 31 14:59:21.958736 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:21.959445 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:21.960423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 231/418] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:21 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:21.968665 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:21.969153 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:21.969816 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:21.971147 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:21.971989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:21.973155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:22.070282 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:22.070811 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:22.076760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:22.077247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:22.077679 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:22.078374 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:22.078825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:22.079519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:22.201460 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:22.213246 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:22.214773 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:22.215952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-74ba2288-05a9-43aa-86fb-b362e013b01d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.262015 Oct 31 14:59:22.216499 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 188/419] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:21 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:22.216643 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:22.225090 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-98f312fc-5baf-4e4a-9de7-6cf213f00abd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.159747 Oct 31 14:59:22.225645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 232/420] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:22 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:22.984343 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:22.985069 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:22.991723 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:22.992265 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:22.992693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:22.993456 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:22.993886 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:22.994306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:23.184505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-73a6feea-dfd7-48e3-b3d3-cc05aaea6808 req-bd9f7de8-3b0e-44de-af08-976a1c1310af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b5253e-385d-419d-9fdc-d04de43ab441", "tag": "6a9e3150-6dc5-47df-9fbf-dfca71a2568d"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:23.196037 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-73a6feea-dfd7-48e3-b3d3-cc05aaea6808 req-bd9f7de8-3b0e-44de-af08-976a1c1310af service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:23.196560 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-73a6feea-dfd7-48e3-b3d3-cc05aaea6808 req-bd9f7de8-3b0e-44de-af08-976a1c1310af service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:23.196979 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-73a6feea-dfd7-48e3-b3d3-cc05aaea6808 req-bd9f7de8-3b0e-44de-af08-976a1c1310af service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:23.209654 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-73a6feea-dfd7-48e3-b3d3-cc05aaea6808 req-bd9f7de8-3b0e-44de-af08-976a1c1310af service nova] Creating event network-changed:6a9e3150-6dc5-47df-9fbf-dfca71a2568d for instance 19b5253e-385d-419d-9fdc-d04de43ab441 on hv-cinder-86022 Oct 31 14:59:23.214329 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-73a6feea-dfd7-48e3-b3d3-cc05aaea6808 req-bd9f7de8-3b0e-44de-af08-976a1c1310af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034610 Oct 31 14:59:23.214942 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 233/421] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:23.244957 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:23.245652 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:23.251950 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:23.252431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:23.252860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:23.253639 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:23.254795 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:23.255222 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:23.343325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:23.351876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2bfa440a-8991-4b9e-8284-ebde31b81112 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.371298 Oct 31 14:59:23.352802 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 189/422] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:22 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:23.357948 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:23.358563 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:23.365088 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:23.365872 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:23.366503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:23.367477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:23.368013 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:23.368694 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:23.417590 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:23.426822 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:23.428378 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:23.429544 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-299e92ca-4a82-4c63-a243-365d47bceeec tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.188789 Oct 31 14:59:23.430101 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 234/423] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:23 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:23.759205 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:23.767009 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-eb5af715-be66-4a27-b493-9dbc5da8f1fc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.412837 Oct 31 14:59:23.767604 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 190/424] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:23 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:24.383780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:24.384310 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:24.391089 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:24.391607 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:24.392049 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:24.392855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:24.393320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:24.393744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:24.454749 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:24.455238 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:24.457952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:24.464349 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:24.464990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:24.465484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:24.466217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:24.466670 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:24.467091 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:24.539091 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:24.549685 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5357433a-8c06-4e7d-b9b1-cfd606309413 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.171255 Oct 31 14:59:24.551823 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 235/425] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:24 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:24.630075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:24.638850 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:24.640338 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:24.641489 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2e4d4c80-6f65-4811-8923-94da4d035bdf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.191152 Oct 31 14:59:24.646516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 191/426] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:24 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:24.792039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:24.792775 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:24.794874 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:24.795830 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=14 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:24.804781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:24.805395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:24.806257 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:24.807177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:24.807743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:24.808244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:24.938834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:24.947448 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4fa724cc-1a67-4ebb-8bba-9b77edb0dfd9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.160480 Oct 31 14:59:24.948039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 236/427] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:24 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:25.573716 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:25.574413 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:25.576805 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=8 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:25.583833 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:25.584066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:25.584640 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:25.585510 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:25.585967 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:25.586391 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:25.673594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:25.673594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:25.682002 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:25.682938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:25.683820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:25.685032 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:25.685872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:25.686745 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:25.829697 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:25.840265 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ce56cfa5-274a-4038-a66a-fe2c07bf2951 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.270927 Oct 31 14:59:25.858466 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:25.860229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 192/428] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:25 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:25.870544 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:25.872293 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:25.873580 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0e177a75-ad03-4e91-8dc4-1e7e8795a286 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.206068 Oct 31 14:59:25.875597 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 237/429] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:25 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:25.970206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:25.970817 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:25.977219 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:25.977705 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:25.978227 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:25.978817 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:25.979264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:25.979803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:26.312048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:26.321392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1b523646-edfe-4952-b89d-f2e1e706625d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.354883 Oct 31 14:59:26.322359 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 193/430] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:25 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:26.875784 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:26.877488 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:26.892188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:26.892188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:26.892188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:26.892188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:26.892538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:26.892538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:26.906057 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:26.906671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:26.920667 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:26.921154 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:26.921584 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:26.922710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:26.923481 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:26.924241 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:27.294981 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:27.298148 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:27.317810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:27.319660 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-59588927-645e-4ad9-aa6b-680f61dba1f4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.446527 Oct 31 14:59:27.330973 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 238/431] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:26 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:27.332986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:27.351681 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c47b0e2d-6c1d-43c4-a821-ac6df9b094a2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.432562 Oct 31 14:59:27.352730 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 194/432] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:26 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:27.356766 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-363b53d9-08ef-460b-be5a-e861858470a1 req-bb1977eb-b0cb-4d2d-9a66-d77a0e64c06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764f83d2-ab35-4b21-a738-a7f366fddf0e", "name": "network-vif-plugged", "status": "completed", "tag": "eca3597d-1f0c-4411-bf26-b163a2db64fc"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:27.362524 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:27.363794 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:27.379110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:27.380539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:27.382801 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:27.384588 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:27.385922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-363b53d9-08ef-460b-be5a-e861858470a1 req-bb1977eb-b0cb-4d2d-9a66-d77a0e64c06e service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:27.386565 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:27.387141 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:27.387813 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-363b53d9-08ef-460b-be5a-e861858470a1 req-bb1977eb-b0cb-4d2d-9a66-d77a0e64c06e service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:27.389138 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-363b53d9-08ef-460b-be5a-e861858470a1 req-bb1977eb-b0cb-4d2d-9a66-d77a0e64c06e service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:27.425035 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:27.436477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-363b53d9-08ef-460b-be5a-e861858470a1 req-bb1977eb-b0cb-4d2d-9a66-d77a0e64c06e service nova] Creating event network-vif-plugged:eca3597d-1f0c-4411-bf26-b163a2db64fc for instance 764f83d2-ab35-4b21-a738-a7f366fddf0e on hv-cinder-86022 Oct 31 14:59:27.454681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-363b53d9-08ef-460b-be5a-e861858470a1 req-bb1977eb-b0cb-4d2d-9a66-d77a0e64c06e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111953 Oct 31 14:59:27.455832 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 239/433] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:27.668916 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:27.688678 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-73b4d1aa-6175-4d4d-812d-e1804d402501 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.333080 Oct 31 14:59:27.694689 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 195/434] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:27 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:28.357887 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:28.358814 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:28.367078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:28.367677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:28.368189 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:28.368995 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:28.369544 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:28.370060 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:28.394228 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:28.395587 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:28.403675 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:28.404529 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:28.405187 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:28.406226 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:28.406865 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:28.407491 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:28.570417 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:28.585017 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1f40975d-dbf4-4723-9f10-166eaf9c38e0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.231208 Oct 31 14:59:28.585621 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 240/435] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:28 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:28.606699 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:28.637793 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:28.641745 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:28.643192 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-310dc00f-e957-4e4c-bf81-d37405811aeb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.253907 Oct 31 14:59:28.648429 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 196/436] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:28 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:28.719093 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:28.719755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:28.728874 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:28.729369 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:28.729807 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:28.730514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:28.731018 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:28.731440 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:28.941916 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:28.951270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-055668c4-fcfe-4b65-b910-963801e60475 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.236172 Oct 31 14:59:28.952540 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 241/437] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:28 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:29.473442 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-1684dedd-d5fd-4cfe-a8a9-c88feba98fc1 req-7347b898-f7f6-4a43-a1ea-0102166d6d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b5253e-385d-419d-9fdc-d04de43ab441", "name": "network-vif-plugged", "status": "completed", "tag": "6a9e3150-6dc5-47df-9fbf-dfca71a2568d"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:29.484833 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-1684dedd-d5fd-4cfe-a8a9-c88feba98fc1 req-7347b898-f7f6-4a43-a1ea-0102166d6d56 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:29.486226 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-1684dedd-d5fd-4cfe-a8a9-c88feba98fc1 req-7347b898-f7f6-4a43-a1ea-0102166d6d56 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:29.486904 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-1684dedd-d5fd-4cfe-a8a9-c88feba98fc1 req-7347b898-f7f6-4a43-a1ea-0102166d6d56 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:29.499716 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-1684dedd-d5fd-4cfe-a8a9-c88feba98fc1 req-7347b898-f7f6-4a43-a1ea-0102166d6d56 service nova] Creating event network-vif-plugged:6a9e3150-6dc5-47df-9fbf-dfca71a2568d for instance 19b5253e-385d-419d-9fdc-d04de43ab441 on hv-cinder-86022 Oct 31 14:59:29.505577 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-1684dedd-d5fd-4cfe-a8a9-c88feba98fc1 req-7347b898-f7f6-4a43-a1ea-0102166d6d56 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035921 Oct 31 14:59:29.506215 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 197/438] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:29.610633 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:29.611931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:29.618458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:29.618938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:29.619370 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:29.620213 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:29.620750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:29.621167 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:29.673485 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:29.674583 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:29.681288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:29.681854 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:29.682359 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:29.683126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:29.683699 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:29.684189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:29.766473 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:29.781621 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-486bb7f1-0017-49fa-a6d0-c4e1294a04ad tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.175246 Oct 31 14:59:29.787007 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 242/439] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:29 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:29.896749 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:29.906108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:29.907581 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:29.909107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-46c1f374-8302-493b-94df-57b7f42c748a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.240078 Oct 31 14:59:29.912619 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 198/440] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:29 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:29.974964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:29.975888 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:29.982130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:29.982621 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:29.983058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:29.983794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:29.984249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:29.984668 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:30.149498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:30.157675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1772c062-aba5-4d67-af2c-e4458461fef9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.186671 Oct 31 14:59:30.158252 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 243/441] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:29 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:30.805395 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:30.806221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:30.812987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:30.813480 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:30.813920 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:30.814628 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:30.815080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:30.815539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:30.942028 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:30.942792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:30.951087 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:30.951786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:30.952228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:30.959295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:30.959897 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:30.960404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:30.996064 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:31.006887 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3ee7898b-7a2e-4c03-a450-22e2510e1e0b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.205220 Oct 31 14:59:31.020812 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 199/442] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:30 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:31.139769 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:31.151233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:31.153699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:31.154001 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e96d91b1-2dd2-4cf4-ba98-6db4ae2c09e8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.217192 Oct 31 14:59:31.154629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 244/443] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:30 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:31.183534 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:31.184455 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:31.191254 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:31.192135 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:31.192774 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:31.193780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:31.194409 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:31.195030 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:31.399956 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:31.408350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-73762eb7-a57b-425a-a17b-9b112d4f3be0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.230212 Oct 31 14:59:31.412765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 200/444] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:31 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:32.036456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:32.037720 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:32.044834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:32.045518 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:32.046125 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:32.047010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:32.047459 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:32.050907 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:32.188743 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:32.189483 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:32.196763 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:32.197360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:32.197997 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:32.198736 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:32.199180 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:32.200317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:32.341029 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:32.352166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2b5892ec-a66b-4f1d-a965-f8bfd421ee85 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.320189 Oct 31 14:59:32.360871 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 245/445] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:32 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:32.423844 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:32.435234 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:32.437276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:32.437442 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:32.438250 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:32.438920 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-cdc67a77-88d9-43c9-89db-81ee2a20714f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.253835 Oct 31 14:59:32.445642 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:32.446309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:32.446763 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:32.447499 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:32.448004 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:32.448426 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:32.454890 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 201/446] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:32 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:32.587906 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:32.595433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7d0d5496-f591-4e7d-981f-3361b00c2dc4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.162089 Oct 31 14:59:32.596015 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 246/447] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:32 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:33.376090 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:33.376722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:33.383244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:33.383787 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:33.384217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:33.384895 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:33.385336 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:33.385751 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:33.467598 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:33.471097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:33.479371 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:33.480352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:33.480975 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:33.481691 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:33.482152 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:33.482579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:33.538910 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:33.548482 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5e2e484d-95cf-4cc1-b06b-ffbf4ecb97cf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.176091 Oct 31 14:59:33.550230 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 202/448] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:33 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:33.621969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:33.632302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:33.640162 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:33.640647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:33.641080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:33.641789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:33.642115 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:33.642274 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:33.642624 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:33.650908 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:33.652379 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:33.653783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d355e3a9-a058-44dd-ae47-0952d50872bf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.190881 Oct 31 14:59:33.654331 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 247/449] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:33 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:33.784582 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:33.792552 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-23935263-c8e0-482d-a793-0c29b7aabceb tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.174806 Oct 31 14:59:33.793117 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 203/450] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:33 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:34.572042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:34.572635 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:34.579574 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:34.580074 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:34.580506 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:34.581713 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:34.582164 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:34.582585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:34.678805 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:34.679398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:34.685742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:34.686216 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:34.686646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:34.687327 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:34.687810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:34.688229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:34.714004 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:34.723770 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b47cdb00-e5ac-48ff-b8eb-c1351555eed3 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.155540 Oct 31 14:59:34.724347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 248/451] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:34 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:34.815867 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:34.816488 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:34.821674 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:34.822723 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:34.823213 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:34.823677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:34.824430 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:34.825219 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:34.825651 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:34.830664 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:34.832555 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:34.833710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d2392ea5-57e5-4150-b5a4-0da9ed3fd407 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.159445 Oct 31 14:59:34.834265 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 204/452] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:34 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:34.951071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:34.958992 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8f3615f4-ef92-4eed-848f-2b2e9701d2c7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.146951 Oct 31 14:59:34.959576 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 249/453] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:34 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:35.747220 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:35.748414 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:35.756206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:35.757130 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:35.757685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:35.758672 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:35.759268 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:35.759851 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:35.764456 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=100 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:35.860502 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:35.861281 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:35.868926 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:35.869406 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:35.870010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:35.871089 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:35.871870 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:35.872404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:36.002032 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:36.010972 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f442fb05-bd8f-4098-86b0-b4e4a649cd2f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.268061 Oct 31 14:59:36.011800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 205/454] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:35 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:36.017141 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:36.017935 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:36.018634 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:36.026589 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:36.027216 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:36.027687 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:36.028387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:36.028913 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:36.029248 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:36.030896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:36.032717 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:36.034081 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ae38f485-f011-4b19-8fee-6b035601d3b7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.177855 Oct 31 14:59:36.034714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 250/455] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:35 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:36.162911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:36.170516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6ea10faf-1fc4-4800-9d39-c734081737a0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.157430 Oct 31 14:59:36.171076 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 206/456] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:36 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:37.033522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:37.034496 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:37.041122 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:37.041597 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:37.042025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:37.042703 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:37.043148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:37.043579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:37.060552 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:37.061160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:37.068226 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:37.068705 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:37.069144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:37.069831 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:37.070279 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:37.070698 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:37.176170 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:37.183769 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-39583eff-4142-4ea3-8a32-4df3d5d14b33 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1370 microversion: 2.1 time: 0.154061 Oct 31 14:59:37.184328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 251/457] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:37 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:37.194232 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:37.194958 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:37.200664 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:37.201148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:37.201576 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:37.201956 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:37.202258 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:37.202700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:37.203118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:37.211474 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:37.212944 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:37.214109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2bf3180a-9be9-436f-8b19-150b97f7b862 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.157523 Oct 31 14:59:37.214658 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 207/458] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:37 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:37.336199 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:37.343906 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a176dbed-c988-4c86-af77-45e61eb515ae tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1367 microversion: 2.1 time: 0.154104 Oct 31 14:59:37.344661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 252/459] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:37 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 14:59:38.208407 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:38.209009 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:38.215495 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.216071 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.216506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.217192 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.217644 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.218065 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.239226 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:38.240469 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:38.246817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.247293 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.247751 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.248432 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.248877 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.249294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.351372 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:38.358960 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1f1552c0-323f-4f50-8539-ebd3b0a4bd3f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1563 microversion: 2.1 time: 0.155192 Oct 31 14:59:38.359517 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 208/460] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:38 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:38.372356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:38.372948 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:38.378962 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.379435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.379895 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.380583 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.381026 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.381438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.382817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:38.391359 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:38.392842 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:38.394539 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5988905d-fef2-48be-9ee0-89d1c4fb8179 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.159186 Oct 31 14:59:38.395214 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 253/461] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:38 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 14:59:38.416253 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c9aee77a-219e-4a40-8630-dc1cb70346e4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:38.416740 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c9aee77a-219e-4a40-8630-dc1cb70346e4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:38.422537 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c9aee77a-219e-4a40-8630-dc1cb70346e4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.423017 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c9aee77a-219e-4a40-8630-dc1cb70346e4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.423453 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c9aee77a-219e-4a40-8630-dc1cb70346e4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.424166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c9aee77a-219e-4a40-8630-dc1cb70346e4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.424721 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c9aee77a-219e-4a40-8630-dc1cb70346e4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.425254 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c9aee77a-219e-4a40-8630-dc1cb70346e4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.507850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c9aee77a-219e-4a40-8630-dc1cb70346e4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095161 Oct 31 14:59:38.508634 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 254/462] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 31 14:59:38 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:38.519326 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:38.527653 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-bc7093fd-a075-4c87-b065-cacb22161ab6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1556 microversion: 2.1 time: 0.158815 Oct 31 14:59:38.528542 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 209/463] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 14:59:38 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 14:59:38.550851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-67d2f944-782f-4f3b-a09e-ec1bef1555b5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:38.551457 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-67d2f944-782f-4f3b-a09e-ec1bef1555b5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:38.557280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67d2f944-782f-4f3b-a09e-ec1bef1555b5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.557768 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67d2f944-782f-4f3b-a09e-ec1bef1555b5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.558289 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67d2f944-782f-4f3b-a09e-ec1bef1555b5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.558963 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67d2f944-782f-4f3b-a09e-ec1bef1555b5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:38.559415 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67d2f944-782f-4f3b-a09e-ec1bef1555b5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:38.559862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-67d2f944-782f-4f3b-a09e-ec1bef1555b5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:38.641687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-67d2f944-782f-4f3b-a09e-ec1bef1555b5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094766 Oct 31 14:59:38.642271 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 255/464] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 31 14:59:38 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:39.425275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:39.426285 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:39.433087 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:39.433662 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:39.434158 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:39.434926 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:39.435442 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:39.435990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:39.817063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-10b0eb37-e6a7-4e1e-84b2-73f5cf3b6627 req-d36d873a-9c49-45b1-85f6-9bbb2ba0b074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b5253e-385d-419d-9fdc-d04de43ab441", "tag": "6a9e3150-6dc5-47df-9fbf-dfca71a2568d"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:39.831260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-10b0eb37-e6a7-4e1e-84b2-73f5cf3b6627 req-d36d873a-9c49-45b1-85f6-9bbb2ba0b074 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:39.831971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-10b0eb37-e6a7-4e1e-84b2-73f5cf3b6627 req-d36d873a-9c49-45b1-85f6-9bbb2ba0b074 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:39.832405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-10b0eb37-e6a7-4e1e-84b2-73f5cf3b6627 req-d36d873a-9c49-45b1-85f6-9bbb2ba0b074 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:39.851065 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-10b0eb37-e6a7-4e1e-84b2-73f5cf3b6627 req-d36d873a-9c49-45b1-85f6-9bbb2ba0b074 service nova] Creating event network-changed:6a9e3150-6dc5-47df-9fbf-dfca71a2568d for instance 19b5253e-385d-419d-9fdc-d04de43ab441 on hv-cinder-86022 Oct 31 14:59:39.856320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-10b0eb37-e6a7-4e1e-84b2-73f5cf3b6627 req-d36d873a-9c49-45b1-85f6-9bbb2ba0b074 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043271 Oct 31 14:59:39.857521 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 256/465] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:39.964220 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:39.976189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:39.977713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:39.978994 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-270a4f1a-3a59-4313-ad4e-1d1d78bb720e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.558348 Oct 31 14:59:39.981336 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 210/466] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:39 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:40.351005 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-b1b63900-140a-4b8c-a835-360cb0843e81 req-fb4502e9-ed04-41af-a0f2-f563e3e0247f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764f83d2-ab35-4b21-a738-a7f366fddf0e", "tag": "eca3597d-1f0c-4411-bf26-b163a2db64fc"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:40.360919 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b1b63900-140a-4b8c-a835-360cb0843e81 req-fb4502e9-ed04-41af-a0f2-f563e3e0247f service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:40.361388 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b1b63900-140a-4b8c-a835-360cb0843e81 req-fb4502e9-ed04-41af-a0f2-f563e3e0247f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:40.362075 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b1b63900-140a-4b8c-a835-360cb0843e81 req-fb4502e9-ed04-41af-a0f2-f563e3e0247f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:40.373363 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-b1b63900-140a-4b8c-a835-360cb0843e81 req-fb4502e9-ed04-41af-a0f2-f563e3e0247f service nova] Creating event network-changed:eca3597d-1f0c-4411-bf26-b163a2db64fc for instance 764f83d2-ab35-4b21-a738-a7f366fddf0e on hv-cinder-86022 Oct 31 14:59:40.378635 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-b1b63900-140a-4b8c-a835-360cb0843e81 req-fb4502e9-ed04-41af-a0f2-f563e3e0247f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032442 Oct 31 14:59:40.379398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 257/467] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:41.006364 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:41.007580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:41.013160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:41.015073 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:41.015829 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:41.016520 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:41.017435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:41.018675 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:41.019324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:41.170040 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:41.180475 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:41.182266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:41.183800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-22923bbb-c4b7-4742-9158-19af5fe8cfc4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.182530 Oct 31 14:59:41.184631 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 211/468] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:41 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:42.211504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:42.212342 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:42.218523 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:42.219001 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:42.219433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:42.220142 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:42.220584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:42.221533 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:42.236142 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:42.353904 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:42.363276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:42.364735 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:42.365882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2213307f-7af5-4d48-bde4-4f782eaee11d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.159230 Oct 31 14:59:42.366449 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 258/469] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:42 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:43.390939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:43.391572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:43.399188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:43.399697 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:43.400138 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:43.400827 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:43.401276 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:43.401722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:43.530556 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:43.540068 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:43.541582 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:43.542916 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3a226476-9d71-499d-a4fa-5c14e5aab6aa tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.155766 Oct 31 14:59:43.543528 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 212/470] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:43 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:44.568241 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:44.568850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:44.575248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:44.575768 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:44.576204 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:44.576893 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:44.577342 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:44.577764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:44.706456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:44.715282 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:44.716746 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:44.717904 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c73ed2fe-da2c-486d-be04-defbf19b7865 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.153658 Oct 31 14:59:44.718465 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 259/471] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:44 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:44.785492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-51e6373c-4b68-4446-bd0a-90cc9e7c863c req-6c5ffa6b-4d99-4c0d-8268-de7c3801ee5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214568bd-3ebf-4f91-8153-d60959d49119", "name": "network-vif-plugged", "status": "completed", "tag": "6951bd8b-ac72-4ceb-9344-47d91749e055"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 14:59:44.795631 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-51e6373c-4b68-4446-bd0a-90cc9e7c863c req-6c5ffa6b-4d99-4c0d-8268-de7c3801ee5f service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:44.796108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-51e6373c-4b68-4446-bd0a-90cc9e7c863c req-6c5ffa6b-4d99-4c0d-8268-de7c3801ee5f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:44.796536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-51e6373c-4b68-4446-bd0a-90cc9e7c863c req-6c5ffa6b-4d99-4c0d-8268-de7c3801ee5f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:44.808691 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-51e6373c-4b68-4446-bd0a-90cc9e7c863c req-6c5ffa6b-4d99-4c0d-8268-de7c3801ee5f service nova] Creating event network-vif-plugged:6951bd8b-ac72-4ceb-9344-47d91749e055 for instance 214568bd-3ebf-4f91-8153-d60959d49119 on hv-cinder-86022 Oct 31 14:59:44.813202 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-51e6373c-4b68-4446-bd0a-90cc9e7c863c req-6c5ffa6b-4d99-4c0d-8268-de7c3801ee5f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031984 Oct 31 14:59:44.813801 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 213/472] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 14:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 14:59:45.743909 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:45.744525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:45.750584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:45.751077 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:45.751514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:45.752222 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:45.752673 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:45.753101 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:45.885048 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:45.893593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:45.895847 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:45.897011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d8b403e8-e070-4bd7-8123-08ddc8a97945 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.157196 Oct 31 14:59:45.897558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 260/473] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:45 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:46.923339 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:46.924059 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:46.931010 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:46.931494 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:46.931949 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:46.932646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:46.933120 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:46.933556 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:47.071691 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:47.082686 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:47.084297 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:47.085696 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2d24fb25-ab78-4e60-91b2-43b93bd5ea8f tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1810 microversion: 2.20 time: 0.167256 Oct 31 14:59:47.086330 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 214/474] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:46 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:48.113285 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:48.113818 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:48.120482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:48.120972 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:48.121392 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:48.122081 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:48.122529 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:48.122966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:48.248910 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:48.257917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:48.259343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 14:59:48.260539 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-224858a8-9432-42e5-95d9-338b71c35873 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1797 microversion: 2.20 time: 0.151719 Oct 31 14:59:48.261088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 261/475] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 14:59:48 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1797 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 14:59:59.297931 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 14:59:59.298518 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 14:59:59.301826 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=7 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:59.302473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=54 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:59.307914 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:59.308394 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:59.308827 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:59.309513 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 14:59:59.309971 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 14:59:59.310387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 14:59:59.435223 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lazy-loading 'services' on Instance uuid 820c59dc-ee1a-4470-b9d6-14060ebd8337 {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 14:59:59.550095 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b7cb60b4-51cb-4314-b626-6a2f6af31cac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "DELETE /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/os-volume_attachments/ec0b48fa-a7e1-44c3-9bfb-59b68b1d3ce1" status: 202 len: 0 microversion: 2.1 time: 0.255050 Oct 31 14:59:59.550729 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 215/476] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 14:59:59 2022] DELETE /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/os-volume_attachments/ec0b48fa-a7e1-44c3-9bfb-59b68b1d3ce1 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:00:00.670611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fd034564-36dc-44c3-8a28-fe6ce04af7ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:00.673235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=69 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:00.673892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=21 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:00.680079 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd034564-36dc-44c3-8a28-fe6ce04af7ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:00.680567 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd034564-36dc-44c3-8a28-fe6ce04af7ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:00.681008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd034564-36dc-44c3-8a28-fe6ce04af7ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:00.705730 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-fd034564-36dc-44c3-8a28-fe6ce04af7ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Going to try to stop instance {{(pid=134339) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:00:00.747542 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-fd034564-36dc-44c3-8a28-fe6ce04af7ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/action" status: 202 len: 0 microversion: 2.1 time: 0.080561 Oct 31 15:00:00.748198 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 262/477] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 15:00:00 2022] POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:00:00.757656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:00.758386 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:00.765080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:00.765687 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:00.766308 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:00.766811 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:00.767258 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:00.768243 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:00.906194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:00.914015 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6abab748-88d8-490d-bc74-805f088bcca6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1675 microversion: 2.1 time: 0.161191 Oct 31 15:00:00.914583 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 216/478] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:00 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:01.938330 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:01.939029 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:01.945357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:01.945844 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:01.946281 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:01.946966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:01.947421 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:01.947875 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:02.090697 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:02.099670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-dd5fc9cc-ccba-4f11-8e04-a0cfeadfbfef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1675 microversion: 2.1 time: 0.165870 Oct 31 15:00:02.100251 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 263/479] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:01 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:03.122917 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:03.123586 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:03.130254 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:03.130727 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:03.131155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:03.131878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:03.132320 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:03.132732 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:03.201291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:00:03.201521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Mon Oct 31 15:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 (ip 10.222.0.36) !!! Oct 31 15:00:03.260026 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:03.268116 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1401c416-a967-4c00-bb96-ed7ae0603099 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1675 microversion: 2.1 time: 0.149010 Oct 31 15:00:03.268713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 217/480] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:03 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:04.291712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:04.292397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:04.300019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:04.300501 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:04.300951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:04.301632 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:04.302077 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:04.302491 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:04.429245 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:04.437155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7a5d1542-ba56-4687-995c-d9f38d785ee6 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1675 microversion: 2.1 time: 0.149280 Oct 31 15:00:04.437714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 264/481] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:04 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:05.461644 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:05.462247 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:05.468580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:05.469061 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:05.469484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:05.470156 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:05.470661 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:05.471157 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:05.598519 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:05.606074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-075d15d5-402a-4855-a3a7-528f8192cd0a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1675 microversion: 2.1 time: 0.148308 Oct 31 15:00:05.606632 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 218/482] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:05 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:06.629173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:06.629788 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:06.636225 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:06.636705 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:06.637139 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:06.637844 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:06.638294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:06.638717 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:06.768567 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:06.776488 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-bfd18ee1-dab1-46d4-99b7-ab1ce64db7aa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1675 microversion: 2.1 time: 0.151237 Oct 31 15:00:06.777053 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 265/483] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:06 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:07.801160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:07.801708 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:07.808008 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.809045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.809045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:07.809654 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:07.810097 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:07.810513 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:07.941566 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:07.949115 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-55c38d90-90ee-4ff2-a0af-3c6f8820a764 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1675 microversion: 2.1 time: 0.152630 Oct 31 15:00:07.949673 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 219/484] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:07 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:08.972573 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:08.973207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:08.979816 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:08.980293 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:08.980752 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:08.981435 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:08.981884 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:08.982307 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:09.113868 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:09.121407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c7a80262-de67-4724-a6a0-d860ae18af5b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1675 microversion: 2.1 time: 0.152921 Oct 31 15:00:09.121964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 266/485] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:08 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:10.144627 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:10.145236 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:10.152572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:10.153051 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:10.153484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:10.154162 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:10.154607 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:10.155023 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:10.283871 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:10.291396 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9ce76867-ccfd-4778-932b-deb32675f484 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1675 microversion: 2.1 time: 0.150637 Oct 31 15:00:10.291988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 220/486] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:10 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:11.314380 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:11.315211 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:11.321741 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:11.322216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:11.322646 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:11.323330 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:11.323810 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:11.324231 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:11.451819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:11.460322 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6f6c5855-e615-4e29-be48-339b07e02fb5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1652 microversion: 2.1 time: 0.149811 Oct 31 15:00:11.460866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 267/487] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:11 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1652 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:11.482369 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-fd55b340-0bfc-4e07-a561-627bb20d283f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:11.488976 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fd55b340-0bfc-4e07-a561-627bb20d283f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:11.489458 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fd55b340-0bfc-4e07-a561-627bb20d283f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:11.489885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fd55b340-0bfc-4e07-a561-627bb20d283f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:11.550466 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-fd55b340-0bfc-4e07-a561-627bb20d283f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Going to try to start instance {{(pid=134338) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:00:11.591923 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-fd55b340-0bfc-4e07-a561-627bb20d283f tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/action" status: 202 len: 0 microversion: 2.1 time: 0.113053 Oct 31 15:00:11.592690 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 221/488] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 15:00:11 2022] POST /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:00:11.600786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:11.601408 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:11.607502 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:11.608019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:11.608512 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:11.609175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:11.609618 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:11.610032 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:11.746741 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:11.755078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0c9e40c1-20c3-484a-9b0a-71731df28902 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1661 microversion: 2.1 time: 0.158185 Oct 31 15:00:11.755671 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 268/489] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:11 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:12.779075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:12.779795 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:12.787016 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:12.787436 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:12.787921 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:12.788614 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:12.789087 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:12.789512 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:12.920929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:12.929158 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-616fe408-a0b0-49b4-965b-4881e762aaae tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1661 microversion: 2.1 time: 0.154608 Oct 31 15:00:12.929727 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 222/490] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:12 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:13.952744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:13.953350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:13.959934 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:13.960403 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:13.960831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:13.961504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:13.961947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:13.962363 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:14.091738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:14.100034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-246b77eb-65a6-4b74-a3d8-d2f6f7b37186 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1665 microversion: 2.1 time: 0.151298 Oct 31 15:00:14.100758 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 269/491] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:13 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:23.777940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e929bf5b-22be-40a7-80a9-70fd7848f651 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:23.778477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e929bf5b-22be-40a7-80a9-70fd7848f651 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:23.781207 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=16 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:23.781880 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:23.787748 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e929bf5b-22be-40a7-80a9-70fd7848f651 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:23.788225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e929bf5b-22be-40a7-80a9-70fd7848f651 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:23.788657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e929bf5b-22be-40a7-80a9-70fd7848f651 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:23.789350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e929bf5b-22be-40a7-80a9-70fd7848f651 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:23.789800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e929bf5b-22be-40a7-80a9-70fd7848f651 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:23.790244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e929bf5b-22be-40a7-80a9-70fd7848f651 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:23.815895 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e929bf5b-22be-40a7-80a9-70fd7848f651 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441/ips" status: 200 len: 148 microversion: 2.1 time: 0.041819 Oct 31 15:00:23.816460 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 223/492] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 15:00:23 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:23.828544 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf78a00-4fac-4d6c-ac21-0dee3e71c828"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:23.830985 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:23.837123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:23.837593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:23.838019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:23.838694 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:23.839138 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:23.839582 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:23.919469 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Invalid volume: volume acf78a00-4fac-4d6c-ac21-0dee3e71c828 is already attached to instances: 90f3404c-864a-4f8c-9444-8b3740b79f7b Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: POST /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441/os-volume_attachments HTTP/1.1 Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 74 Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:00:23.921234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {"volumeAttachment": {"volumeId": "acf78a00-4fac-4d6c-ac21-0dee3e71c828"}} Oct 31 15:00:23.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Invalid volume: volume acf78a00-4fac-4d6c-ac21-0dee3e71c828 is already attached to instances: 90f3404c-864a-4f8c-9444-8b3740b79f7b Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'server_id': '19b5253e-385d-419d-9fdc-d04de43ab441', 'body': {'volumeAttachment': {'volumeId': 'acf78a00-4fac-4d6c-ac21-0dee3e71c828'}}} Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume acf78a00-4fac-4d6c-ac21-0dee3e71c828 is already attached to instances: 90f3404c-864a-4f8c-9444-8b3740b79f7b Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:23.924200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume acf78a00-4fac-4d6c-ac21-0dee3e71c828 is already attached to instances: 90f3404c-864a-4f8c-9444-8b3740b79f7b Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:23.925395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:23.926545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:23.926545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:00:23.926545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:00:23.926545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume acf78a00-4fac-4d6c-ac21-0dee3e71c828 is already attached to instances: 90f3404c-864a-4f8c-9444-8b3740b79f7b Oct 31 15:00:23.926545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:23.926545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 400 to user: Invalid volume: volume acf78a00-4fac-4d6c-ac21-0dee3e71c828 is already attached to instances: 90f3404c-864a-4f8c-9444-8b3740b79f7b {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:00:23.926545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9dfb03c3-1053-47ca-9b2b-175ef8422747 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098662 Oct 31 15:00:23.926545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 270/493] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:00:23 2022] POST /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:00:23.932018 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:23.932504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:23.938431 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:23.939542 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:23.939989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:23.940666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:23.941108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:23.941523 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:23.965869 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:00:24.043824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c2fa0b98-5ba0-4009-8503-51916fd49082 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 204 len: 0 microversion: 2.1 time: 0.115150 Oct 31 15:00:24.044537 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 224/494] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:00:23 2022] DELETE /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:00:24.053792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:24.054588 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:24.061325 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:24.061810 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:24.062248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:24.062938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:24.063391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:24.064917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:24.196262 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:24.204391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4be30515-1af4-4304-b846-bc7ab32177db tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1680 microversion: 2.1 time: 0.155283 Oct 31 15:00:24.204961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 271/495] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:24 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:24.390541 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1dc10a94-30df-40d3-9ead-94a0b80bc7a2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10348efa-808b-4ddf-85c4-10452d32ecc2"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:24.393719 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1dc10a94-30df-40d3-9ead-94a0b80bc7a2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:24.399759 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1dc10a94-30df-40d3-9ead-94a0b80bc7a2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:24.400234 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1dc10a94-30df-40d3-9ead-94a0b80bc7a2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:24.400661 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1dc10a94-30df-40d3-9ead-94a0b80bc7a2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:24.401341 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1dc10a94-30df-40d3-9ead-94a0b80bc7a2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:24.401784 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1dc10a94-30df-40d3-9ead-94a0b80bc7a2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:24.402201 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1dc10a94-30df-40d3-9ead-94a0b80bc7a2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:25.230045 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:25.230653 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:25.237740 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:25.238215 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:25.238648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:25.239330 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:25.239811 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:25.240237 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:25.370268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:25.378532 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3e3c885b-41c6-4135-939b-7d6c14b7b698 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1680 microversion: 2.1 time: 0.152330 Oct 31 15:00:25.379088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 272/496] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:25 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:25.551388 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1dc10a94-30df-40d3-9ead-94a0b80bc7a2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.165103 Oct 31 15:00:25.552031 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 225/497] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:00:24 2022] POST /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments => generated 194 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:26.402629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:26.403141 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:26.410007 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:26.410493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:26.410927 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:26.411705 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:26.412391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:26.412815 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:26.477696 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:26.489095 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0c9d38b8-4202-4868-adf9-3c4680dfd804 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 200 len: 1612 microversion: 2.1 time: 0.090589 Oct 31 15:00:26.490226 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 273/498] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:26 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 1612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:26.599324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-5ddbed3a-f270-468b-b143-f96efcf5e25e req-a56e8803-9318-48f1-92f8-5160231133f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b5253e-385d-419d-9fdc-d04de43ab441", "name": "network-vif-deleted", "tag": "6a9e3150-6dc5-47df-9fbf-dfca71a2568d"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:26.609885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-5ddbed3a-f270-468b-b143-f96efcf5e25e req-a56e8803-9318-48f1-92f8-5160231133f0 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:26.610365 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-5ddbed3a-f270-468b-b143-f96efcf5e25e req-a56e8803-9318-48f1-92f8-5160231133f0 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:26.610876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-5ddbed3a-f270-468b-b143-f96efcf5e25e req-a56e8803-9318-48f1-92f8-5160231133f0 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:26.624431 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-5ddbed3a-f270-468b-b143-f96efcf5e25e req-a56e8803-9318-48f1-92f8-5160231133f0 service nova] Creating event network-vif-deleted:6a9e3150-6dc5-47df-9fbf-dfca71a2568d for instance 19b5253e-385d-419d-9fdc-d04de43ab441 on hv-cinder-86022 Oct 31 15:00:26.630494 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-5ddbed3a-f270-468b-b143-f96efcf5e25e req-a56e8803-9318-48f1-92f8-5160231133f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035314 Oct 31 15:00:26.631142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 226/499] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:27.511980 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:27.512595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:27.522572 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:27.522572 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:27.522572 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:27.522572 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:27.522974 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:27.522974 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:27.536030 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 HTTP/1.1 Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:00:27.537568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:00:27.538855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '19b5253e-385d-419d-9fdc-d04de43ab441'} Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:00:27.539716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:00:27.540885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:27.541928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:00:27.541928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-acea3061-b816-4a8d-9c06-b5ff0c9dbd98 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 404 len: 111 microversion: 2.1 time: 0.030935 Oct 31 15:00:27.541928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 274/500] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:27 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:00:27.549691 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-850abaa1-e992-465a-8308-31a9da4cbb7f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '.version_select at 0x7f6c70e8ba60>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:27.575177 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-850abaa1-e992-465a-8308-31a9da4cbb7f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595097263" status: 202 len: 0 microversion: 2.1 time: 0.030666 Oct 31 15:00:27.575798 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 227/501] 10.222.0.36 () {58 vars in 1218 bytes} [Mon Oct 31 15:00:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595097263 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:00:28.407911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-95bb3da7-ab30-4c8f-9c25-43dc89d166a1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:28.408500 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-95bb3da7-ab30-4c8f-9c25-43dc89d166a1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:28.414571 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-95bb3da7-ab30-4c8f-9c25-43dc89d166a1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.415268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-95bb3da7-ab30-4c8f-9c25-43dc89d166a1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.415735 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-95bb3da7-ab30-4c8f-9c25-43dc89d166a1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.416486 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-95bb3da7-ab30-4c8f-9c25-43dc89d166a1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.416941 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-95bb3da7-ab30-4c8f-9c25-43dc89d166a1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.417361 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-95bb3da7-ab30-4c8f-9c25-43dc89d166a1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.450512 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-95bb3da7-ab30-4c8f-9c25-43dc89d166a1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments/d40ade40-9ab0-45b7-b162-3d0d5747251e" status: 200 len: 194 microversion: 2.20 time: 0.046881 Oct 31 15:00:28.451104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 275/502] 10.222.0.36 () {60 vars in 1454 bytes} [Mon Oct 31 15:00:28 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments/d40ade40-9ab0-45b7-b162-3d0d5747251e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:00:28.509285 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:28.509890 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:28.516857 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.517347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.517786 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.518491 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.518945 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.519268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:28.519700 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.519781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:28.527671 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.528161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.528603 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.529306 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.529757 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.530183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.600971 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lazy-loading 'services' on Instance uuid 90f3404c-864a-4f8c-9444-8b3740b79f7b {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:00:28.657079 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lazy-loading 'services' on Instance uuid 214568bd-3ebf-4f91-8153-d60959d49119 {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:00:28.676201 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d6097e7c-a0f4-4398-bc67-c7c405a26de8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments/acf78a00-4fac-4d6c-ac21-0dee3e71c828" status: 202 len: 0 microversion: 2.1 time: 0.171021 Oct 31 15:00:28.677288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 228/503] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:00:28 2022] DELETE /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments/acf78a00-4fac-4d6c-ac21-0dee3e71c828 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:00:28.685960 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0a04a26b-28c4-40b8-ac8c-36be094771c3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:28.688498 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0a04a26b-28c4-40b8-ac8c-36be094771c3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:28.702106 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a04a26b-28c4-40b8-ac8c-36be094771c3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.702706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a04a26b-28c4-40b8-ac8c-36be094771c3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.703210 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a04a26b-28c4-40b8-ac8c-36be094771c3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.704152 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a04a26b-28c4-40b8-ac8c-36be094771c3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.704861 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a04a26b-28c4-40b8-ac8c-36be094771c3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.705486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a04a26b-28c4-40b8-ac8c-36be094771c3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.744987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0a04a26b-28c4-40b8-ac8c-36be094771c3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063018 Oct 31 15:00:28.745851 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 229/504] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:00:28 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:00:28.795060 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f1abf7a2-6017-4565-817f-63ff31ce6020 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "DELETE /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments/d40ade40-9ab0-45b7-b162-3d0d5747251e" status: 202 len: 0 microversion: 2.20 time: 0.279516 Oct 31 15:00:28.799806 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 276/505] 10.222.0.36 () {60 vars in 1457 bytes} [Mon Oct 31 15:00:28 2022] DELETE /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments/d40ade40-9ab0-45b7-b162-3d0d5747251e => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:00:28.805216 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3f0bc8e2-1913-42d6-8986-5c27231321d5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:28.807435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3f0bc8e2-1913-42d6-8986-5c27231321d5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:28.813957 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f0bc8e2-1913-42d6-8986-5c27231321d5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.814461 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f0bc8e2-1913-42d6-8986-5c27231321d5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.814939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f0bc8e2-1913-42d6-8986-5c27231321d5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.815742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f0bc8e2-1913-42d6-8986-5c27231321d5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:28.816572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f0bc8e2-1913-42d6-8986-5c27231321d5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:28.817241 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f0bc8e2-1913-42d6-8986-5c27231321d5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:28.860267 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3f0bc8e2-1913-42d6-8986-5c27231321d5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058891 Oct 31 15:00:28.861466 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 230/506] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 31 15:00:28 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:00:29.759478 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-172822df-6617-4ede-a8fe-5cff284e1769 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:29.761733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-172822df-6617-4ede-a8fe-5cff284e1769 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:29.768006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-172822df-6617-4ede-a8fe-5cff284e1769 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:29.768477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-172822df-6617-4ede-a8fe-5cff284e1769 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:29.768903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-172822df-6617-4ede-a8fe-5cff284e1769 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:29.769584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-172822df-6617-4ede-a8fe-5cff284e1769 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:29.770029 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-172822df-6617-4ede-a8fe-5cff284e1769 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:29.770446 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-172822df-6617-4ede-a8fe-5cff284e1769 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:29.787103 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:29.802983 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-172822df-6617-4ede-a8fe-5cff284e1769 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048312 Oct 31 15:00:29.803539 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 277/507] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:00:29 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:29.874528 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e52b17ae-8df7-4b7e-85b1-238c2d15f7f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:29.877243 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e52b17ae-8df7-4b7e-85b1-238c2d15f7f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:29.883713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e52b17ae-8df7-4b7e-85b1-238c2d15f7f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:29.884193 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e52b17ae-8df7-4b7e-85b1-238c2d15f7f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:29.884629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e52b17ae-8df7-4b7e-85b1-238c2d15f7f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:29.885322 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e52b17ae-8df7-4b7e-85b1-238c2d15f7f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:29.885769 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e52b17ae-8df7-4b7e-85b1-238c2d15f7f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:29.886190 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e52b17ae-8df7-4b7e-85b1-238c2d15f7f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:29.917105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e52b17ae-8df7-4b7e-85b1-238c2d15f7f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046755 Oct 31 15:00:29.917671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 231/508] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 31 15:00:29 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:00:30.815585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7bfcd711-8523-4bf8-93e3-7fe95b098fa4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:30.817694 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7bfcd711-8523-4bf8-93e3-7fe95b098fa4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:30.820246 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=33 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:30.825347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bfcd711-8523-4bf8-93e3-7fe95b098fa4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:30.825817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bfcd711-8523-4bf8-93e3-7fe95b098fa4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:30.826274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bfcd711-8523-4bf8-93e3-7fe95b098fa4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:30.827212 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bfcd711-8523-4bf8-93e3-7fe95b098fa4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:30.827678 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bfcd711-8523-4bf8-93e3-7fe95b098fa4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:30.828094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7bfcd711-8523-4bf8-93e3-7fe95b098fa4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:30.858546 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7bfcd711-8523-4bf8-93e3-7fe95b098fa4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047061 Oct 31 15:00:30.859107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 278/509] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:00:30 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:30.929376 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f6e6164f-d25b-492c-8c75-6d311624a23d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:30.931708 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f6e6164f-d25b-492c-8c75-6d311624a23d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:30.938182 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6e6164f-d25b-492c-8c75-6d311624a23d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:30.939292 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6e6164f-d25b-492c-8c75-6d311624a23d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:30.939876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6e6164f-d25b-492c-8c75-6d311624a23d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:30.940564 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6e6164f-d25b-492c-8c75-6d311624a23d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:30.941007 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6e6164f-d25b-492c-8c75-6d311624a23d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:30.941426 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f6e6164f-d25b-492c-8c75-6d311624a23d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:30.973718 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f6e6164f-d25b-492c-8c75-6d311624a23d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048186 Oct 31 15:00:30.974544 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 232/510] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 31 15:00:30 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:00:31.871641 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e7e4a878-a431-443b-9bee-4f2e2896bb2f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:31.873682 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e7e4a878-a431-443b-9bee-4f2e2896bb2f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:31.880521 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7e4a878-a431-443b-9bee-4f2e2896bb2f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:31.881006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7e4a878-a431-443b-9bee-4f2e2896bb2f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:31.881438 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7e4a878-a431-443b-9bee-4f2e2896bb2f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:31.882123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7e4a878-a431-443b-9bee-4f2e2896bb2f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:31.882576 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7e4a878-a431-443b-9bee-4f2e2896bb2f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:31.883001 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e7e4a878-a431-443b-9bee-4f2e2896bb2f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:31.912629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e7e4a878-a431-443b-9bee-4f2e2896bb2f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Oct 31 15:00:31.913180 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 279/511] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:00:31 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:31.987070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ba51df1a-5034-4b4e-975c-07fd22de889d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:31.989258 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ba51df1a-5034-4b4e-975c-07fd22de889d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:31.996398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51df1a-5034-4b4e-975c-07fd22de889d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:31.996873 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51df1a-5034-4b4e-975c-07fd22de889d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:31.997905 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51df1a-5034-4b4e-975c-07fd22de889d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:31.998624 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51df1a-5034-4b4e-975c-07fd22de889d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:31.999058 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51df1a-5034-4b4e-975c-07fd22de889d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:31.999478 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51df1a-5034-4b4e-975c-07fd22de889d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:32.035509 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ba51df1a-5034-4b4e-975c-07fd22de889d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052867 Oct 31 15:00:32.036284 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 233/512] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 31 15:00:31 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:00:32.925397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-74b80f42-e471-4a35-a19b-0f98970e9f31 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:32.927788 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-74b80f42-e471-4a35-a19b-0f98970e9f31 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:32.934842 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74b80f42-e471-4a35-a19b-0f98970e9f31 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:32.936176 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74b80f42-e471-4a35-a19b-0f98970e9f31 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:32.936952 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74b80f42-e471-4a35-a19b-0f98970e9f31 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:32.937647 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74b80f42-e471-4a35-a19b-0f98970e9f31 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:32.938175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74b80f42-e471-4a35-a19b-0f98970e9f31 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:32.939157 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74b80f42-e471-4a35-a19b-0f98970e9f31 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:32.969444 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-74b80f42-e471-4a35-a19b-0f98970e9f31 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048516 Oct 31 15:00:32.970162 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 280/513] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:00:32 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:00:33.037002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:33.037542 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:33.043800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.044273 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.044699 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.045379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.045823 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.046238 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.048948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e5ecefc8-2bb3-4066-a7f8-ceb895b02232 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:33.051168 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e5ecefc8-2bb3-4066-a7f8-ceb895b02232 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:33.056938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e5ecefc8-2bb3-4066-a7f8-ceb895b02232 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.057418 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e5ecefc8-2bb3-4066-a7f8-ceb895b02232 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.057851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e5ecefc8-2bb3-4066-a7f8-ceb895b02232 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.058594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e5ecefc8-2bb3-4066-a7f8-ceb895b02232 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.059044 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e5ecefc8-2bb3-4066-a7f8-ceb895b02232 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.059468 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e5ecefc8-2bb3-4066-a7f8-ceb895b02232 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.073896 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:00:33.099687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e5ecefc8-2bb3-4066-a7f8-ceb895b02232 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055012 Oct 31 15:00:33.101342 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 281/514] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 31 15:00:33 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:00:33.166451 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-250eb75b-a65b-490c-b253-1dbf1f6b2975 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 204 len: 0 microversion: 2.1 time: 0.133068 Oct 31 15:00:33.167222 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 234/515] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:00:33 2022] DELETE /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:00:33.175958 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:33.176513 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:33.183827 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.184538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.185143 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.185855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.186295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.186873 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.204756 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:33.207437 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:33.213532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.214014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.214446 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.215145 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.215631 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.216092 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.241274 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lazy-loading 'flavor' on Instance uuid 764f83d2-ab35-4b21-a738-a7f366fddf0e {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:00:33.258496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:33.327381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:33.335716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-aa3b438c-2b46-43d0-9271-4fa520390911 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1682 microversion: 2.1 time: 0.163947 Oct 31 15:00:33.336648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 282/516] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:33 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:33.380418 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-732736f2-25f1-4c11-9619-4a93af8eb6a4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/action" status: 200 len: 32 microversion: 2.1 time: 0.180550 Oct 31 15:00:33.381498 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 235/517] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 15:00:33 2022] POST /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:00:33.390489 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:33.391107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:33.397673 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.398148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.398585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.399275 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:33.399758 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:33.400187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:33.530991 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:33.540300 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-09265861-9296-4604-934c-f96be20e7e53 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.153586 Oct 31 15:00:33.540895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 283/518] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:33 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:34.113925 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e845c128-a905-4517-bf4b-19cff3bec3cc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:34.116203 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e845c128-a905-4517-bf4b-19cff3bec3cc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:34.122841 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e845c128-a905-4517-bf4b-19cff3bec3cc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:34.123311 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e845c128-a905-4517-bf4b-19cff3bec3cc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:34.123775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e845c128-a905-4517-bf4b-19cff3bec3cc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:34.124452 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e845c128-a905-4517-bf4b-19cff3bec3cc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:34.124922 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e845c128-a905-4517-bf4b-19cff3bec3cc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:34.125336 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e845c128-a905-4517-bf4b-19cff3bec3cc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:34.155047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e845c128-a905-4517-bf4b-19cff3bec3cc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045645 Oct 31 15:00:34.155605 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 236/519] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 31 15:00:34 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:00:34.362254 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:34.362852 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:34.369343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:34.369761 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:34.370189 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:34.370890 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:34.371336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:34.371785 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:34.509880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:34.517581 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5ef8120f-9011-441c-a14b-5d68cfdc6f36 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1682 microversion: 2.1 time: 0.159671 Oct 31 15:00:34.518145 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 284/520] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:34 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:34.563974 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:34.564610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:34.570732 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:34.571211 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:34.571662 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:34.572344 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:34.572790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:34.573204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:34.770214 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:34.778821 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a00a9407-38c4-4eb9-be7e-c33fc4153d7a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.219348 Oct 31 15:00:34.779388 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 237/521] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:34 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:35.167873 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6e75b2c8-1933-4bcd-9074-4a34a073a849 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:35.170016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6e75b2c8-1933-4bcd-9074-4a34a073a849 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:35.176350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e75b2c8-1933-4bcd-9074-4a34a073a849 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.176827 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e75b2c8-1933-4bcd-9074-4a34a073a849 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.177272 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e75b2c8-1933-4bcd-9074-4a34a073a849 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.177961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e75b2c8-1933-4bcd-9074-4a34a073a849 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.178401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e75b2c8-1933-4bcd-9074-4a34a073a849 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.178819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e75b2c8-1933-4bcd-9074-4a34a073a849 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.209278 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6e75b2c8-1933-4bcd-9074-4a34a073a849 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045470 Oct 31 15:00:35.209846 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 285/522] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 31 15:00:35 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:35.274122 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:35.274673 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:35.281005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.281486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.282512 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.283386 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.283868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.284291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.310946 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:00:35.397129 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a11afd56-467f-4e91-a6aa-52eecea03bdc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "DELETE /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 204 len: 0 microversion: 2.20 time: 0.125896 Oct 31 15:00:35.399862 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 238/523] 10.222.0.36 () {60 vars in 1280 bytes} [Mon Oct 31 15:00:35 2022] DELETE /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:00:35.409076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:35.409703 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:35.416459 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.416947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.417384 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.418084 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.418538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.418978 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.541274 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:35.542256 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:35.549313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.549936 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.550641 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.551654 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.552423 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.553094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.568401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:35.577259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:35.579495 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:35.580693 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-531d04ae-105f-49c7-9b94-c96bb01e3260 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.176667 Oct 31 15:00:35.581239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 286/524] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:35 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:35.637755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:35.646504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7e7b2b63-4ff4-4140-9402-614971a0d468 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1614 microversion: 2.1 time: 0.109461 Oct 31 15:00:35.647074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 239/525] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:35 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:35.802787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:35.803324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:35.809301 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.809786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.810215 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.810899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.811350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.811802 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.906748 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-ad495d83-151d-46f7-a48a-070788bfa201 req-5071d28f-2849-49a7-9d90-fc608dd67c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f3404c-864a-4f8c-9444-8b3740b79f7b", "name": "network-vif-deleted", "tag": "066e375b-5369-47d6-9723-3f3d6ad24590"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:35.916539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-ad495d83-151d-46f7-a48a-070788bfa201 req-5071d28f-2849-49a7-9d90-fc608dd67c01 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:35.917013 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-ad495d83-151d-46f7-a48a-070788bfa201 req-5071d28f-2849-49a7-9d90-fc608dd67c01 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:35.917436 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-ad495d83-151d-46f7-a48a-070788bfa201 req-5071d28f-2849-49a7-9d90-fc608dd67c01 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:35.932154 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-ad495d83-151d-46f7-a48a-070788bfa201 req-5071d28f-2849-49a7-9d90-fc608dd67c01 service nova] Creating event network-vif-deleted:066e375b-5369-47d6-9723-3f3d6ad24590 for instance 90f3404c-864a-4f8c-9444-8b3740b79f7b on hv-cinder-86022 Oct 31 15:00:35.946117 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-ad495d83-151d-46f7-a48a-070788bfa201 req-5071d28f-2849-49a7-9d90-fc608dd67c01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043000 Oct 31 15:00:35.946733 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 240/526] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:00:35.968401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:35.977123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7ccb60d0-1e83-47be-92e3-047b29020974 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.178177 Oct 31 15:00:35.986900 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 287/527] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:35 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:36.607607 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:36.608673 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:36.615151 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:36.615655 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:36.616085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:36.616767 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:36.617211 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:36.617623 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:36.670148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:36.670926 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:36.679776 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:36.692196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:36.693000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:36.694016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:36.694553 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:36.695189 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:36.782886 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:36.793187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-52dcfd5a-6853-43a7-a8a9-155595c83cd4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 200 len: 1326 microversion: 2.1 time: 0.125762 Oct 31 15:00:36.794565 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 288/528] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:36 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 1326 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:36.807486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:36.818394 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:36.819923 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:36.821285 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3da06c82-ad39-4768-a350-36c566c58f0b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1725 microversion: 2.20 time: 0.218436 Oct 31 15:00:36.827590 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 241/529] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:36 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:37.004242 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:37.005034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:37.011207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:37.011725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:37.012158 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:37.012870 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:37.013491 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:37.013912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:37.158027 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:37.168986 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-772a732c-27f7-4219-9266-7da5f0deeb78 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.169837 Oct 31 15:00:37.169819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 289/530] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:36 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:37.817718 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:37.818392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:37.825249 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:37.825802 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:37.826292 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:37.827311 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:37.827874 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:37.828355 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:37.845100 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b HTTP/1.1 Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:00:37.848070 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:00:37.849685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '90f3404c-864a-4f8c-9444-8b3740b79f7b'} Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:00:37.850608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:00:37.852299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:37.853595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:00:37.853690 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:37.854106 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7b462f0a-a6d0-4158-859b-cee0d92bead5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 404 len: 111 microversion: 2.1 time: 0.037824 Oct 31 15:00:37.854196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:37.857489 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 242/531] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:37 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:00:37.861512 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:37.862075 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:37.862666 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:37.863594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:37.863715 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b0291eca-2e30-4f6f-a10c-e7fdcf858c2a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '.version_select at 0x7f6c70ecc310>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:37.864228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:37.864835 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:37.889312 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b0291eca-2e30-4f6f-a10c-e7fdcf858c2a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546437633" status: 202 len: 0 microversion: 2.1 time: 0.030588 Oct 31 15:00:37.894941 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 243/532] 10.222.0.36 () {58 vars in 1221 bytes} [Mon Oct 31 15:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546437633 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:00:37.956515 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:37.974087 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-0e7d54a7-9b8d-4ce0-ac77-11579b5c68ff req-fdd1b13a-704c-48c9-9d13-2186edda566d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214568bd-3ebf-4f91-8153-d60959d49119", "name": "network-vif-deleted", "tag": "6951bd8b-ac72-4ceb-9344-47d91749e055"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:37.974713 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:37.979211 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:37.984050 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-32d80722-2c33-4b44-aab7-d212322ae43e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 200 len: 1657 microversion: 2.20 time: 0.138927 Oct 31 15:00:37.985998 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 290/533] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:37 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 1657 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:37.995128 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-0e7d54a7-9b8d-4ce0-ac77-11579b5c68ff req-fdd1b13a-704c-48c9-9d13-2186edda566d service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:37.995980 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-0e7d54a7-9b8d-4ce0-ac77-11579b5c68ff req-fdd1b13a-704c-48c9-9d13-2186edda566d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:37.996596 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-0e7d54a7-9b8d-4ce0-ac77-11579b5c68ff req-fdd1b13a-704c-48c9-9d13-2186edda566d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:38.023408 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-0e7d54a7-9b8d-4ce0-ac77-11579b5c68ff req-fdd1b13a-704c-48c9-9d13-2186edda566d service nova] Creating event network-vif-deleted:6951bd8b-ac72-4ceb-9344-47d91749e055 for instance 214568bd-3ebf-4f91-8153-d60959d49119 on hv-cinder-86022 Oct 31 15:00:38.035183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-0e7d54a7-9b8d-4ce0-ac77-11579b5c68ff req-fdd1b13a-704c-48c9-9d13-2186edda566d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064845 Oct 31 15:00:38.039135 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 244/534] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:38.193871 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:38.194409 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:38.204131 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:38.204613 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:38.205561 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:38.206692 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:38.207297 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:38.207796 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:38.360324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:38.368623 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a48760d8-e62f-43c3-ba1b-1675892a7cf7 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.179673 Oct 31 15:00:38.369193 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 291/535] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:38 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:38.921903 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-51adcd32-7242-4c38-aefd-036ca7a9e090 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: .version_select at 0x7f6c70d609d0>, body: {"keypair": {"name": "tempest-keypair-1382629410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE2DeC2fKQt6Isp9BOeb1FYEVyQvMJrVceIFWf++Xn2BasQ4PVCVQPZyL9IKWP/wpHHNMdeDUaFumI8r2B0GinkdUSfk5fKK9JJGiytysQYUrmtZM/Fat5ltunB9WdxnA=="}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:38.939541 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-51adcd32-7242-4c38-aefd-036ca7a9e090 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for project f629aa044ca845069237ecb8d889284e. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:00:38.943775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-51adcd32-7242-4c38-aefd-036ca7a9e090 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for user cdcbcb2ed9e44dbe8444e531fc1eb707 and project f629aa044ca845069237ecb8d889284e. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:00:38.965880 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-51adcd32-7242-4c38-aefd-036ca7a9e090 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048225 Oct 31 15:00:38.966466 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 245/536] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 15:00:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:39.013061 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:39.013681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:39.020240 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:39.020734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:39.021178 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:39.021875 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:39.022332 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:39.022755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:39.036498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] HTTP exception thrown: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Request method failure captured: Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 HTTP/1.1 Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-IpIM8HjEUg1xXYmWVF6XNHdYaimkvKsFm9frHgDf3FUxsEHeRiUdSVnUYrE1_E_SzTRJhFtK5QXbn0FsCpsVy98Oxf5AEinY4fZY70tpZQxCDGDbFvYrlDSR72E94nB8R-nCj1Aokgfr2Er59iB35wwDPF8c63uvn7kOjYfMqeIJU Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:00:39.038187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5119fe6e3c064da0a66218481a944aaa"}]}] Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: e1fb0b1657cd43baaa93a16ce6d9ec8f Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:00:39.039913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '214568bd-3ebf-4f91-8153-d60959d49119'} Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:00:39.040834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:00:39.042201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:39.043405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Returning 404 to user: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:00:39.043405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c3111ab6-0c14-41f6-8c81-1ced4fcb133a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 404 len: 111 microversion: 2.20 time: 0.030509 Oct 31 15:00:39.043405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 292/537] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:39 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:00:39.050779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-64b00deb-b4a3-44be-9949-b87890ee7a42 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '.version_select at 0x7f6c70da7a60>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:39.071966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-64b00deb-b4a3-44be-9949-b87890ee7a42 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610460469" status: 204 len: 0 microversion: 2.20 time: 0.026343 Oct 31 15:00:39.072631 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 246/538] 10.222.0.36 () {60 vars in 1262 bytes} [Mon Oct 31 15:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610460469 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 15:00:39.392589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:39.393202 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:39.403865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:39.404347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:39.404972 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:39.405674 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:39.406301 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:39.407462 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:39.670908 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:39.680504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-01cf58ea-ffca-4427-b723-68e5b17cda92 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.291865 Oct 31 15:00:39.681070 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 293/539] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:39 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:39.931879 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-950f5839-7459-44ca-8c5a-939cce22fb10 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'create', calling method: .version_select at 0x7f6c70d89d30>, body: {"keypair": {"name": "tempest-keypair-709641179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/08O84DM/EBtNEQB3bhWx/5zTyCPlJslAwfbvgGmnunQnTPjMgys/+c5e1nLW8ITfFR+afdIdA4DeXDh5oxpV81hXdCWWl9485NgUu+ZeNh/X9JfFTp1RJ3O4SnvGXWA=="}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:39.947262 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-950f5839-7459-44ca-8c5a-939cce22fb10 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Getting quotas for project 5119fe6e3c064da0a66218481a944aaa. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:00:39.951031 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-950f5839-7459-44ca-8c5a-939cce22fb10 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Getting quotas for user e1fb0b1657cd43baaa93a16ce6d9ec8f and project 5119fe6e3c064da0a66218481a944aaa. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:00:39.976663 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-950f5839-7459-44ca-8c5a-939cce22fb10 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049546 Oct 31 15:00:39.977435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 247/540] 10.222.0.36 () {62 vars in 1200 bytes} [Mon Oct 31 15:00:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:00:40.706141 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:40.706750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:40.722834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:40.723325 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:40.723789 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:40.724525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:40.724982 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:40.725433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:40.811459 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-226993635", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "344848ef-d9a5-4f9a-8ddf-c96c364ed358"}], "security_groups": [{"name": "tempest-securitygroup--449329689"}], "key_name": "tempest-keypair-1382629410", "user_data": "}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:40.917803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] validate_networks() for [('344848ef-d9a5-4f9a-8ddf-c96c364ed358', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:00:40.947913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:40.951264 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:40.958920 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-df100627-382a-4794-aa82-2b25ffc8d428 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.257838 Oct 31 15:00:40.959794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 294/541] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:40 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:41.299746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:00:41.300449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:00:41.300754 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:00:41.301174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:00:41.301601 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:00:41.304650 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:41.311805 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:41.312284 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:41.313528 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:41.314256 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:41.314712 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:41.315140 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:41.336535 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for project f629aa044ca845069237ecb8d889284e. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:00:41.340777 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for user cdcbcb2ed9e44dbe8444e531fc1eb707 and project f629aa044ca845069237ecb8d889284e. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:00:41.352311 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:00:41.354682 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:00:41.389448 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1283505463", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5834683c-3d1a-4deb-b1fe-c3f585ecb7f7"}], "security_groups": [{"name": "tempest-securitygroup--1933597435"}], "key_name": "tempest-keypair-709641179", "user_data": "}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:41.405524 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a7cffc9c-854d-43d7-a522-c8604ba02a46 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.599695 Oct 31 15:00:41.407646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 248/542] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:00:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:00:41.426615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c47d65bf-ff26-4f5a-808f-32da29af7c35 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:41.427243 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c47d65bf-ff26-4f5a-808f-32da29af7c35 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:41.492589 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c47d65bf-ff26-4f5a-808f-32da29af7c35 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:41.501061 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c47d65bf-ff26-4f5a-808f-32da29af7c35 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1241 microversion: 2.1 time: 0.080369 Oct 31 15:00:41.501625 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 249/543] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:41 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:41.517826 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] validate_networks() for [('5834683c-3d1a-4deb-b1fe-c3f585ecb7f7', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:00:41.942039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:00:41.942620 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:00:41.942880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:00:41.943287 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:00:41.943727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:00:41.952782 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:41.954020 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:41.954471 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:41.955195 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:41.955671 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:41.956095 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:41.972931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Getting quotas for project 5119fe6e3c064da0a66218481a944aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:00:41.976824 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Getting quotas for user e1fb0b1657cd43baaa93a16ce6d9ec8f and project 5119fe6e3c064da0a66218481a944aaa. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:00:41.982324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:41.982936 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:41.987938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:00:41.989994 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:41.990282 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:00:41.990471 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:41.990932 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:41.991655 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:41.992102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:41.992515 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:42.037097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f01c8af5-b439-4537-baa0-837fa234a14d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.651911 Oct 31 15:00:42.037747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 295/544] 10.222.0.36 () {62 vars in 1188 bytes} [Mon Oct 31 15:00:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 31 15:00:42.049579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-49dbfedf-969f-4cf0-a683-702d48676304 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:42.050189 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-49dbfedf-969f-4cf0-a683-702d48676304 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:42.118492 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-49dbfedf-969f-4cf0-a683-702d48676304 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:42.127142 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-49dbfedf-969f-4cf0-a683-702d48676304 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:42.128729 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-49dbfedf-969f-4cf0-a683-702d48676304 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:42.130089 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-49dbfedf-969f-4cf0-a683-702d48676304 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1281 microversion: 2.20 time: 0.085121 Oct 31 15:00:42.143962 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 296/545] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:42 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1281 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:00:42.149615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:42.159581 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-bb319ee4-55a5-43be-916d-1a2901ba30a0 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.181073 Oct 31 15:00:42.160179 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 250/546] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:41 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:42.523027 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:42.523662 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:42.529597 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:42.530072 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:42.530498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:42.531200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:42.532237 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:42.532838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:42.593680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:42.601880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-02f3abe1-d029-4fbb-b976-3e20e70cd6b7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1293 microversion: 2.1 time: 0.082654 Oct 31 15:00:42.602429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 297/547] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:42 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:43.156219 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:43.158084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:43.165825 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:43.166494 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:43.166936 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:43.167694 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:43.168149 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:43.168604 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:43.185544 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:43.188129 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:43.196800 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:43.197497 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:43.198147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:43.199061 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:43.199609 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:43.200393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:43.287940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:43.297268 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:43.299279 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:43.300605 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ea13a6ca-685c-4ec7-9504-1bd89974c171 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1333 microversion: 2.20 time: 0.148208 Oct 31 15:00:43.301447 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 251/548] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:43 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1333 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:43.342475 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:43.350973 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5ed45e58-4840-4b9f-9a0b-e375da7c87d4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.170245 Oct 31 15:00:43.351532 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 298/549] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:43 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:43.625036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:43.625946 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:43.634026 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:43.634642 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:43.635351 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:43.636194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:43.636745 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:43.637257 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:43.934202 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:43.942329 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7944f699-969f-4d8e-9d7d-b261822fcba4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.321188 Oct 31 15:00:43.942904 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 252/550] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:43 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:44.326814 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:44.327423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:44.334860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.335359 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.335819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.336525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.336977 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.337399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.374422 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:44.375679 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:44.382581 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.383065 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.383531 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.384262 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.384723 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.385146 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.405505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:44.415071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:44.416602 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:44.417834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6e386917-3315-4a5c-80cd-8e0d62207d82 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1339 microversion: 2.20 time: 0.095354 Oct 31 15:00:44.418495 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 299/551] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:44 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:44.791719 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:44.801503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-63ea905f-a1bd-4d6c-ad16-e6b715cdd21f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.431146 Oct 31 15:00:44.802080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 253/552] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:44 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:44.965943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:44.966493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:44.973141 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.973714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.974129 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:44.975318 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:44.975838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:44.976262 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:45.121782 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:45.130097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e930cef3-589a-448a-afb2-4961d844b47f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.168069 Oct 31 15:00:45.143580 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 300/553] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:44 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:45.369431 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-ee8d1b32-77e6-4d91-90d6-5ef02d36dc4e req-77275924-7255-4c57-b546-f64781932899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9357fbec-cc10-4069-9fa4-fdeefcbe705b", "tag": "986667c8-d6cc-428f-9699-9ed7f61777ed"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:45.380807 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-ee8d1b32-77e6-4d91-90d6-5ef02d36dc4e req-77275924-7255-4c57-b546-f64781932899 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:45.381428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-ee8d1b32-77e6-4d91-90d6-5ef02d36dc4e req-77275924-7255-4c57-b546-f64781932899 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:45.381698 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-ee8d1b32-77e6-4d91-90d6-5ef02d36dc4e req-77275924-7255-4c57-b546-f64781932899 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:45.395004 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-ee8d1b32-77e6-4d91-90d6-5ef02d36dc4e req-77275924-7255-4c57-b546-f64781932899 service nova] Creating event network-changed:986667c8-d6cc-428f-9699-9ed7f61777ed for instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b on hv-cinder-86022 Oct 31 15:00:45.399964 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-ee8d1b32-77e6-4d91-90d6-5ef02d36dc4e req-77275924-7255-4c57-b546-f64781932899 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035155 Oct 31 15:00:45.400755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 254/554] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:45.443847 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:45.444530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:45.452724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:45.455015 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:45.455529 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:45.456333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:45.456860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:45.457743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:45.597930 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:45.606843 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:45.608319 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:45.611066 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8e14b51b-b2da-4094-8c3b-3f9150d617a8 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1407 microversion: 2.20 time: 0.170073 Oct 31 15:00:45.619688 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 301/555] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:45 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:45.827004 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:45.827838 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:45.834519 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:45.835005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:45.835444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:45.836179 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:45.836628 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:45.837055 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:46.130392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:46.138886 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-fb655f7a-76fc-41ec-8702-03ac0d6c4c2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.316364 Oct 31 15:00:46.139560 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 255/556] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:45 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:46.153257 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:46.154030 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:46.161606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:46.162102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:46.162638 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:46.163335 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:46.163819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:46.164246 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:46.298661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:46.306544 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-12506cea-ea83-40c2-9f39-be0938564ce3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.157070 Oct 31 15:00:46.307111 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 302/557] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:46 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:46.635818 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:46.636392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:46.642794 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:46.643262 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:46.643717 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:46.644391 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:46.644832 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:46.645247 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:46.775006 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:46.783812 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:46.785256 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:46.786359 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9343e09a-fad5-4a1d-b835-c307983799c4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1407 microversion: 2.20 time: 0.154526 Oct 31 15:00:46.786909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 256/558] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:46 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:47.163660 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:47.164270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:47.170911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:47.171402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:47.172098 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:47.172584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:47.173043 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:47.173469 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:47.304058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:47.312492 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7848a6c6-2f98-49c8-a9e9-5aede308eae6 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.152749 Oct 31 15:00:47.313412 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 303/559] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:47 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:47.330889 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:47.331523 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:47.338636 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:47.339117 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:47.339574 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:47.340266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:47.340714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:47.341128 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:47.361080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:47.429215 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-2e967b6e-1915-4d31-bed8-09538a2f6eb8 req-0234ba31-eba8-4af5-9a0c-e31f3095baf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78da101-dab9-43eb-b75d-14baee21f5c0", "tag": "fad9b881-1f6a-40eb-9847-b09fa756357c"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:47.439444 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-2e967b6e-1915-4d31-bed8-09538a2f6eb8 req-0234ba31-eba8-4af5-9a0c-e31f3095baf4 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:47.439966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-2e967b6e-1915-4d31-bed8-09538a2f6eb8 req-0234ba31-eba8-4af5-9a0c-e31f3095baf4 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:47.440396 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-2e967b6e-1915-4d31-bed8-09538a2f6eb8 req-0234ba31-eba8-4af5-9a0c-e31f3095baf4 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:47.451455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-2e967b6e-1915-4d31-bed8-09538a2f6eb8 req-0234ba31-eba8-4af5-9a0c-e31f3095baf4 service nova] Creating event network-changed:fad9b881-1f6a-40eb-9847-b09fa756357c for instance e78da101-dab9-43eb-b75d-14baee21f5c0 on hv-cinder-86022 Oct 31 15:00:47.457457 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-2e967b6e-1915-4d31-bed8-09538a2f6eb8 req-0234ba31-eba8-4af5-9a0c-e31f3095baf4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031950 Oct 31 15:00:47.458103 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 304/560] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:47.652824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:47.660705 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-536fdcf4-533e-4316-869e-ddda9115c305 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.334969 Oct 31 15:00:47.661282 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 257/561] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:47 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:47.812177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:47.815305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:47.821844 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:47.822334 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:47.822780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:47.823480 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:47.823964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:47.824388 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:47.958839 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:47.966956 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:47.968967 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:47.970099 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0313fe9d-aa3f-4cc3-9f56-72a0bbe7bf76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1407 microversion: 2.20 time: 0.162297 Oct 31 15:00:47.970685 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 305/562] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:47 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:48.337164 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:48.337800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:48.344492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:48.344933 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:48.345365 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:48.346047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:48.346501 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:48.346918 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:48.476683 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:48.485436 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e650f256-3ec8-4257-aa91-c741c8ed7ce5 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.152133 Oct 31 15:00:48.486002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 258/563] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:48 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:48.683693 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:48.684309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:48.690833 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:48.691316 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:48.691778 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:48.692480 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:48.692931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:48.693350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:48.825112 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:48.833547 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4016f92a-c4ea-47ad-8a8e-22c420bb68e1 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.153843 Oct 31 15:00:48.834179 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 306/564] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:48 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:48.995760 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:48.996374 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:49.004371 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.004854 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.005286 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.005970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.006415 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.006834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.206758 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f4c0a176-5d63-4044-b350-041c9f404800 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:49.209252 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f4c0a176-5d63-4044-b350-041c9f404800 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:49.215513 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4c0a176-5d63-4044-b350-041c9f404800 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.216578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4c0a176-5d63-4044-b350-041c9f404800 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.216578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4c0a176-5d63-4044-b350-041c9f404800 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.217151 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4c0a176-5d63-4044-b350-041c9f404800 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.217613 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4c0a176-5d63-4044-b350-041c9f404800 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.218202 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4c0a176-5d63-4044-b350-041c9f404800 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.226548 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:49.241143 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:49.246632 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:49.247986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-464fbb4c-4462-40c9-981c-8fd72c78b210 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1407 microversion: 2.20 time: 0.256796 Oct 31 15:00:49.248562 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 259/565] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:48 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:49.256517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f4c0a176-5d63-4044-b350-041c9f404800 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055530 Oct 31 15:00:49.257679 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 307/566] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:00:49 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:00:49.330772 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:49.331262 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:49.337398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.337882 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.338310 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.339017 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.339592 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.340016 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.369171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:00:49.456229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8472312d-2922-459b-a983-f50755dfbe8a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "DELETE /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 204 len: 0 microversion: 2.1 time: 0.128988 Oct 31 15:00:49.457057 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 260/567] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:00:49 2022] DELETE /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:00:49.465175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:49.466017 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:49.472088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.472480 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.472907 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.473584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.474030 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.474446 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.509277 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:49.510183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:49.516913 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.518347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.521636 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.522467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.523036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.523733 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.624970 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:49.633022 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-04b42012-db59-4f98-9533-da0022d706fa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1671 microversion: 2.1 time: 0.171642 Oct 31 15:00:49.633678 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 308/568] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:49 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:49.667324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:49.679198 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1387f49b-0b1e-41c4-b113-3a733e28e661 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.174220 Oct 31 15:00:49.679798 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 261/569] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:49 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:49.856488 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:49.857019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:49.864587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.865072 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.865505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.866188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:49.866638 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:49.867058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:49.996993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:50.006261 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-46237aa4-e804-4570-8a76-ce0d4663a500 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.153669 Oct 31 15:00:50.006822 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 309/570] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:49 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:50.284253 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:50.284858 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:50.291206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:50.291728 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:50.292155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:50.292864 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:50.293309 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:50.293722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:50.419809 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:50.427987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:50.429440 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:50.430583 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e8300b44-ddd3-4520-917f-c45a6eb22605 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1407 microversion: 2.20 time: 0.150892 Oct 31 15:00:50.431175 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 262/571] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:50 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:50.656723 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:50.657329 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:50.663163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:50.663661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:50.664089 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:50.664761 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:50.665203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:50.665640 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:50.701441 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:50.702180 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:50.708181 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:50.708661 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:50.709086 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:50.709802 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:50.710247 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:50.710665 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:50.796103 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:50.804753 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7137353a-538b-480d-bf07-d04d0c246869 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1671 microversion: 2.1 time: 0.152210 Oct 31 15:00:50.805441 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 310/572] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:50 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:51.030020 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:51.031459 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:51.038118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:51.038597 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:51.039031 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:51.039743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:51.040190 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:51.040608 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:51.079251 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:51.087568 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5ed4fd97-807f-402e-994d-f273c1358f44 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.390078 Oct 31 15:00:51.088154 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 263/573] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:50 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:51.171104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:51.179267 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-813dd2e4-d135-46d9-9159-faeb8ebfa299 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.153356 Oct 31 15:00:51.179863 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 311/574] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:51 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:51.456804 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:51.457408 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:51.457856 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-647a56f4-62dd-4a10-b6a1-19f0ca167ab3 req-d5245c12-992d-4f22-ac22-3faf103d2615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78da101-dab9-43eb-b75d-14baee21f5c0", "name": "network-vif-plugged", "status": "completed", "tag": "fad9b881-1f6a-40eb-9847-b09fa756357c"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:51.464425 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:51.466185 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:51.466761 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:51.467180 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:51.468020 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:51.468416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:51.469054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:51.473264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-647a56f4-62dd-4a10-b6a1-19f0ca167ab3 req-d5245c12-992d-4f22-ac22-3faf103d2615 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:51.473957 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-647a56f4-62dd-4a10-b6a1-19f0ca167ab3 req-d5245c12-992d-4f22-ac22-3faf103d2615 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:51.474457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-647a56f4-62dd-4a10-b6a1-19f0ca167ab3 req-d5245c12-992d-4f22-ac22-3faf103d2615 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:51.487428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-647a56f4-62dd-4a10-b6a1-19f0ca167ab3 req-d5245c12-992d-4f22-ac22-3faf103d2615 service nova] Creating event network-vif-plugged:fad9b881-1f6a-40eb-9847-b09fa756357c for instance e78da101-dab9-43eb-b75d-14baee21f5c0 on hv-cinder-86022 Oct 31 15:00:51.493360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-647a56f4-62dd-4a10-b6a1-19f0ca167ab3 req-d5245c12-992d-4f22-ac22-3faf103d2615 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039605 Oct 31 15:00:51.494271 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 264/575] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:51.650956 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:51.660608 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:51.662589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:51.663802 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-78ff95e2-bc82-4677-8d90-7e27c5f4a5e4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1407 microversion: 2.20 time: 0.211795 Oct 31 15:00:51.664350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 312/576] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:51 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:00:51.830439 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:51.831140 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:51.834444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=16 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:51.839002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:51.839709 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:51.840272 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:51.841163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:51.841618 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:51.842243 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.079319 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:52.086911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-68a97ac0-bff7-4bac-acb9-2ac0afe5b5d7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1671 microversion: 2.1 time: 0.261773 Oct 31 15:00:52.087477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 265/577] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:51 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1671 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:52.110226 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:52.114611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:52.115234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:52.121496 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:52.121987 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:52.122439 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.123131 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:52.123677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:52.124110 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.125109 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=8 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:52.217215 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:52.220055 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:52.227116 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:52.227718 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:52.228372 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.229273 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:52.229795 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:52.230362 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.275781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:52.279175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:52.285687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f16c624c-0c3f-44b5-af3b-d71ccf406337 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.177012 Oct 31 15:00:52.286260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 313/578] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:52 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:52.444126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:52.453306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-206d4620-eea9-4ec9-911c-15bfdc7d65bc tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.253464 Oct 31 15:00:52.467579 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 266/579] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:52 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:52.565770 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-23f43131-b127-4b5a-a112-401b57a1000b req-6e1d02ea-fb78-47e7-b1b1-448e30c1abce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820c59dc-ee1a-4470-b9d6-14060ebd8337", "name": "network-vif-deleted", "tag": "24a2724b-5bec-4b7b-938e-508059f058d4"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:52.575471 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-23f43131-b127-4b5a-a112-401b57a1000b req-6e1d02ea-fb78-47e7-b1b1-448e30c1abce service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:52.576482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-23f43131-b127-4b5a-a112-401b57a1000b req-6e1d02ea-fb78-47e7-b1b1-448e30c1abce service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:52.576910 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-23f43131-b127-4b5a-a112-401b57a1000b req-6e1d02ea-fb78-47e7-b1b1-448e30c1abce service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.589162 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-23f43131-b127-4b5a-a112-401b57a1000b req-6e1d02ea-fb78-47e7-b1b1-448e30c1abce service nova] Creating event network-vif-deleted:24a2724b-5bec-4b7b-938e-508059f058d4 for instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 on hv-cinder-86022 Oct 31 15:00:52.594932 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-23f43131-b127-4b5a-a112-401b57a1000b req-6e1d02ea-fb78-47e7-b1b1-448e30c1abce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032958 Oct 31 15:00:52.595524 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 314/580] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:52.690813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:52.691479 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:52.698198 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:52.698677 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:52.699124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.700003 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:52.700456 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:52.701165 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:52.830504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:52.838753 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:52.840236 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:52.841342 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b837ea01-3724-4728-893e-8c6c49be41f4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1407 microversion: 2.20 time: 0.155811 Oct 31 15:00:52.841911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 267/581] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:52 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:53.111490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:53.112251 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:53.119044 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.119528 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.119994 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.120690 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.121143 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.121562 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.193648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:53.204734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b07427be-b871-4257-8f82-05917a6afd78 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1321 microversion: 2.1 time: 0.098109 Oct 31 15:00:53.205305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 315/582] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:53 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1321 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:53.310074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:53.310780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:53.317607 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.318099 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.318536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.319248 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.319729 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.320151 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.478839 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:53.479882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:53.487912 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:53.488843 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.489584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.490810 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.492082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.492780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.493424 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.496808 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0c353909-d11f-4572-9204-26d493e04254 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.190512 Oct 31 15:00:53.497404 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 268/583] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:53 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:53.553999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-8fe95ebf-279a-44e6-a658-110fb2fe2cc6 req-c5d04cb2-0c49-4177-a565-2048f5839fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9357fbec-cc10-4069-9fa4-fdeefcbe705b", "name": "network-vif-plugged", "status": "completed", "tag": "986667c8-d6cc-428f-9699-9ed7f61777ed"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:53.570693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-8fe95ebf-279a-44e6-a658-110fb2fe2cc6 req-c5d04cb2-0c49-4177-a565-2048f5839fc5 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.571171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-8fe95ebf-279a-44e6-a658-110fb2fe2cc6 req-c5d04cb2-0c49-4177-a565-2048f5839fc5 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.574387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-8fe95ebf-279a-44e6-a658-110fb2fe2cc6 req-c5d04cb2-0c49-4177-a565-2048f5839fc5 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.598974 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-8fe95ebf-279a-44e6-a658-110fb2fe2cc6 req-c5d04cb2-0c49-4177-a565-2048f5839fc5 service nova] Creating event network-vif-plugged:986667c8-d6cc-428f-9699-9ed7f61777ed for instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b on hv-cinder-86022 Oct 31 15:00:53.604737 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-8fe95ebf-279a-44e6-a658-110fb2fe2cc6 req-c5d04cb2-0c49-4177-a565-2048f5839fc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056133 Oct 31 15:00:53.606481 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 269/584] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:00:53.661148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:53.671139 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9243847d-11d2-4594-aa55-d5922e3c33f8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.196553 Oct 31 15:00:53.672512 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 316/585] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:53 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:53.868229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:53.868943 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:53.875290 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.875808 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.876246 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:53.876960 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:53.877407 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:53.877826 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.007326 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:54.016042 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:54.017480 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:54.018636 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-fbfb11c5-d10b-4b77-9a35-f29289876a67 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1599 microversion: 2.20 time: 0.155278 Oct 31 15:00:54.019437 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 270/586] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:00:53 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:00:54.043981 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6319b88f-0e09-459d-9248-d29db1264bc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:54.044482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6319b88f-0e09-459d-9248-d29db1264bc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:54.050320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6319b88f-0e09-459d-9248-d29db1264bc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.050802 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6319b88f-0e09-459d-9248-d29db1264bc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.051233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6319b88f-0e09-459d-9248-d29db1264bc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.051953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6319b88f-0e09-459d-9248-d29db1264bc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.052407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6319b88f-0e09-459d-9248-d29db1264bc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.052825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6319b88f-0e09-459d-9248-d29db1264bc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.129129 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6319b88f-0e09-459d-9248-d29db1264bc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088956 Oct 31 15:00:54.129717 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 317/587] 10.222.0.36 () {60 vars in 1316 bytes} [Mon Oct 31 15:00:54 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:00:54.228216 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:54.229373 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:54.235694 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.236254 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.236748 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.237645 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.238294 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.238834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.271621 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.272182 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.272784 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.273385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lazy-loading 'fault' on Instance uuid 820c59dc-ee1a-4470-b9d6-14060ebd8337 {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:00:54.319839 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:54.329779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a3fc4833-da99-4d63-bb91-3bc5babd8d99 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1326 microversion: 2.1 time: 0.105334 Oct 31 15:00:54.354296 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 271/588] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:54 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:54.522263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:54.522882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:54.529618 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.530107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.530590 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.531621 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.532079 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.532502 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.694750 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:54.695360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:54.702096 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.702765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.703204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.703930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:54.704690 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:54.705209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:54.867847 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:54.876180 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2d8b72b7-c091-4761-86ec-1443a7dee936 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.185307 Oct 31 15:00:54.876747 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 272/589] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:54 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:54.885601 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:54.893966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4a0b59ce-b7bb-43fb-baa4-e96461e70a6e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1733 microversion: 2.1 time: 0.375682 Oct 31 15:00:54.894531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 318/590] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:54 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1733 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:55.353978 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:55.354775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:55.362414 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.362906 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.363532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.364266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.364810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.365623 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.387005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:55.400658 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-88d589bf-0869-4059-8003-dfff8804b0a1 req-5a21a907-efb4-4d70-b000-ed0663c1562b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78da101-dab9-43eb-b75d-14baee21f5c0", "tag": "fad9b881-1f6a-40eb-9847-b09fa756357c"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:55.404447 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.404937 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.405469 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.407229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lazy-loading 'fault' on Instance uuid 820c59dc-ee1a-4470-b9d6-14060ebd8337 {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:00:55.410111 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:55.412703 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-88d589bf-0869-4059-8003-dfff8804b0a1 req-5a21a907-efb4-4d70-b000-ed0663c1562b service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.413282 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-88d589bf-0869-4059-8003-dfff8804b0a1 req-5a21a907-efb4-4d70-b000-ed0663c1562b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.413957 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-88d589bf-0869-4059-8003-dfff8804b0a1 req-5a21a907-efb4-4d70-b000-ed0663c1562b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.426975 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-88d589bf-0869-4059-8003-dfff8804b0a1 req-5a21a907-efb4-4d70-b000-ed0663c1562b service nova] Creating event network-changed:fad9b881-1f6a-40eb-9847-b09fa756357c for instance e78da101-dab9-43eb-b75d-14baee21f5c0 on hv-cinder-86022 Oct 31 15:00:55.431993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-88d589bf-0869-4059-8003-dfff8804b0a1 req-5a21a907-efb4-4d70-b000-ed0663c1562b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035620 Oct 31 15:00:55.432972 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 319/591] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:55.453163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:55.461067 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c170cc39-ffe0-4c34-b056-fa25059ea56a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 200 len: 1326 microversion: 2.1 time: 0.112013 Oct 31 15:00:55.461635 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 273/592] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:55 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:55.900349 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:55.901044 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:55.907062 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.907568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.908078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.908774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.909228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.909650 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.917922 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:55.918699 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:55.925440 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.926072 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.926605 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:55.927541 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:55.928250 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:55.929503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.091096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:56.099762 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9d8377f4-7e5c-4c45-85a7-0bfc99a9d337 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1366 microversion: 2.1 time: 0.203528 Oct 31 15:00:56.100359 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 320/593] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:55 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:56.136890 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:56.145939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-dd8e977d-6292-47b4-bdd5-45fefdeaea05 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1713 microversion: 2.1 time: 0.232028 Oct 31 15:00:56.159927 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 274/594] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:55 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1713 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:56.267132 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:56.267746 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:56.273758 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.274479 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.274913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.275655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.276109 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.276537 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.362823 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] HTTP exception thrown: Cannot 'detach_volume' instance 764f83d2-ab35-4b21-a738-a7f366fddf0e while it is in vm_state rescued Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Request method failure captured: Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: DELETE /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments/10348efa-808b-4ddf-85c4-10452d32ecc2 HTTP/1.1 Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0WnXqVoGMkFGjruLglgKS6_fArFbovBTxoWqr2QtwCJEYLprU_tgF4EvTk2yZ_Ect21eHEtFnbIgXByF8FVTVtCG8v209_WYKdYErkOZa0vfsIIuJNfSVDMtha-xW8HjXq9pOJI89chFU9Eyu0QEvuKNGXqm9Kcfdj--tVnG-Ne4 Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:00:56.364455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8bc7c0eaebf146bea1af6b4d708bf62b"}]}] Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: e6bfe2c1ba054935ae8e9fcc054faf68 Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:00:56.366076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Cannot 'detach_volume' instance 764f83d2-ab35-4b21-a738-a7f366fddf0e while it is in vm_state rescued Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'server_id': '764f83d2-ab35-4b21-a738-a7f366fddf0e', 'id': '10348efa-808b-4ddf-85c4-10452d32ecc2'} Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 764f83d2-ab35-4b21-a738-a7f366fddf0e in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:00:56.366943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 764f83d2-ab35-4b21-a738-a7f366fddf0e while it is in vm_state rescued Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 764f83d2-ab35-4b21-a738-a7f366fddf0e while it is in vm_state rescued Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.368490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Returning 409 to user: Cannot 'detach_volume' instance 764f83d2-ab35-4b21-a738-a7f366fddf0e while it is in vm_state rescued {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:00:56.369706 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1c7404f8-e583-42b5-938b-2331b2196c8d tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments/10348efa-808b-4ddf-85c4-10452d32ecc2" status: 409 len: 152 microversion: 2.1 time: 0.103582 Oct 31 15:00:56.369706 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 321/595] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:00:56 2022] DELETE /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments/10348efa-808b-4ddf-85c4-10452d32ecc2 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:00:56.375828 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f150373a-e195-40dd-b8d1-f95a51f931ba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:56.376436 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f150373a-e195-40dd-b8d1-f95a51f931ba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:56.382664 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f150373a-e195-40dd-b8d1-f95a51f931ba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.383143 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f150373a-e195-40dd-b8d1-f95a51f931ba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.383593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f150373a-e195-40dd-b8d1-f95a51f931ba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.384291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f150373a-e195-40dd-b8d1-f95a51f931ba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.384743 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f150373a-e195-40dd-b8d1-f95a51f931ba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.385165 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f150373a-e195-40dd-b8d1-f95a51f931ba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.456742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f150373a-e195-40dd-b8d1-f95a51f931ba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "POST /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/action" status: 202 len: 0 microversion: 2.1 time: 0.085444 Oct 31 15:00:56.457372 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 275/596] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 15:00:56 2022] POST /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:00:56.465482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:56.466121 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:56.473752 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.474240 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.474728 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.475372 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.475876 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.476336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.485505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:56.486213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:56.494984 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.495476 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.495934 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.496633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:56.497087 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:56.497508 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:56.512327 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] HTTP exception thrown: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Request method failure captured: Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 HTTP/1.1 Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-IqM_zV1tPASH1OufiXt4PFjQsznL4Nw-CU1lkjZtpDjcyQzzG5in5uB3SxtypXkJT1OupZCWXK6aiyN0nuWaaAS_3kQ6N1j0D85kV36noiZe9BHEQBRDXs0c2bK1JvpUSpnfAMBPLRpT4md3kfTC94HyNx5HYUTUJJm6eMme4zwz4 Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:00:56.513575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fdab2d4f39c64f239ded71cc9773c8bb"}]}] Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: 75d1901be8064ff5bf79f0268d589e10 Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:00:56.515473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '820c59dc-ee1a-4470-b9d6-14060ebd8337'} Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:00:56.516237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:00:56.517350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:00:56.518406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Returning 404 to user: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:00:56.518406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-316e92d8-f558-4f91-8b54-c23f172d20c0 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 404 len: 111 microversion: 2.1 time: 0.033915 Oct 31 15:00:56.518406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 276/597] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:56 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:00:56.524353 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ff02d245-940f-4f01-b651-e917c12f0915 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '.version_select at 0x7f6c70d60700>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:56.548417 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ff02d245-940f-4f01-b651-e917c12f0915 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040567426" status: 202 len: 0 microversion: 2.1 time: 0.027707 Oct 31 15:00:56.549357 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 277/598] 10.222.0.36 () {58 vars in 1221 bytes} [Mon Oct 31 15:00:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040567426 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:00:56.629953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:56.638941 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c12ec436-911d-4bf7-b296-00d81e319afe tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1721 microversion: 2.1 time: 0.177275 Oct 31 15:00:56.639816 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 322/599] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:56 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:57.123572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:57.125297 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:57.132865 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:57.133350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:57.133779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:57.135430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:57.136571 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:57.137002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:57.202800 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-52a9fe72-80ec-4581-b4a8-6ec850c7af77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'create', calling method: .version_select at 0x7f6c70e2a040>, body: {"keypair": {"name": "tempest-keypair-1963771868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkgLTquTE0/MvXydbz1UdJFit+ya1PA/fhi13AH649bCOMS1lBdAfiCWYDq4UBF4YTnawQxlb5UpAYGA8vSTnJWzcTuYYG/T+F2oepDdWdW70l6te/RUKFRUzFHY6VZPA=="}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:57.219288 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-52a9fe72-80ec-4581-b4a8-6ec850c7af77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Getting quotas for project fdab2d4f39c64f239ded71cc9773c8bb. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:00:57.225737 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-52a9fe72-80ec-4581-b4a8-6ec850c7af77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Getting quotas for user 75d1901be8064ff5bf79f0268d589e10 and project fdab2d4f39c64f239ded71cc9773c8bb. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:00:57.250468 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-52a9fe72-80ec-4581-b4a8-6ec850c7af77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052184 Oct 31 15:00:57.251243 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 323/600] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 15:00:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:00:57.359785 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:57.368357 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-dbd86cff-a744-4924-91c3-ae89fe35e4c4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1555 microversion: 2.1 time: 0.249420 Oct 31 15:00:57.372113 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 278/601] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:57 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:57.396558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-29763d53-f9df-4ff8-84cf-1c89c968a473 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:57.398680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-29763d53-f9df-4ff8-84cf-1c89c968a473 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:57.423852 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29763d53-f9df-4ff8-84cf-1c89c968a473 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:57.424493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29763d53-f9df-4ff8-84cf-1c89c968a473 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:57.424965 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29763d53-f9df-4ff8-84cf-1c89c968a473 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:57.425674 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29763d53-f9df-4ff8-84cf-1c89c968a473 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:57.426123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29763d53-f9df-4ff8-84cf-1c89c968a473 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:57.426536 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29763d53-f9df-4ff8-84cf-1c89c968a473 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:57.509056 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-29763d53-f9df-4ff8-84cf-1c89c968a473 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117137 Oct 31 15:00:57.509759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 324/602] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 31 15:00:57 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:57.667758 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:57.668676 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:57.676593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:57.677133 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:57.677715 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:57.678678 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:57.679878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:57.680301 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:57.881725 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:57.892000 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-88400c20-efa1-47c5-a8ad-699bd2de7210 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1721 microversion: 2.1 time: 0.228207 Oct 31 15:00:57.892762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 279/603] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:57 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:00:58.729989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-71cacbe9-341b-4543-b0a1-1d85bbb0b48f req-4b702a22-c944-4857-b6a3-79b7a3c19acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9357fbec-cc10-4069-9fa4-fdeefcbe705b", "tag": "986667c8-d6cc-428f-9699-9ed7f61777ed"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:58.739928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-71cacbe9-341b-4543-b0a1-1d85bbb0b48f req-4b702a22-c944-4857-b6a3-79b7a3c19acd service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:58.740395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-71cacbe9-341b-4543-b0a1-1d85bbb0b48f req-4b702a22-c944-4857-b6a3-79b7a3c19acd service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:58.740821 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-71cacbe9-341b-4543-b0a1-1d85bbb0b48f req-4b702a22-c944-4857-b6a3-79b7a3c19acd service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:58.752036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-71cacbe9-341b-4543-b0a1-1d85bbb0b48f req-4b702a22-c944-4857-b6a3-79b7a3c19acd service nova] Creating event network-changed:986667c8-d6cc-428f-9699-9ed7f61777ed for instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b on hv-cinder-86022 Oct 31 15:00:58.757187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-71cacbe9-341b-4543-b0a1-1d85bbb0b48f req-4b702a22-c944-4857-b6a3-79b7a3c19acd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031720 Oct 31 15:00:58.758015 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 325/604] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:00:58.787486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1930330642", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9dc557c-0645-443c-a01e-416bcfdc6824"}], "security_groups": [{"name": "tempest-securitygroup--702118773"}], "key_name": "tempest-keypair-1963771868", "user_data": "}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:00:58.916635 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:58.917339 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:58.924794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:58.925276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:58.925896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:58.926797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:58.927246 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:58.927700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:58.936798 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] validate_networks() for [('d9dc557c-0645-443c-a01e-416bcfdc6824', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:00:59.066711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:59.076076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c0219f84-2642-42d0-a63b-71fd02214e28 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1721 microversion: 2.1 time: 0.163364 Oct 31 15:00:59.076924 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 326/605] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:58 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:00:59.761871 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:00:59.762301 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:00:59.762775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:00:59.763185 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:00:59.763632 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:00:59.772814 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:59.773297 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:59.773733 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:59.774461 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:00:59.774915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:00:59.775342 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:00:59.792167 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Getting quotas for project fdab2d4f39c64f239ded71cc9773c8bb. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:00:59.796675 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Getting quotas for user 75d1901be8064ff5bf79f0268d589e10 and project fdab2d4f39c64f239ded71cc9773c8bb. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:00:59.799077 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:59.810681 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:00:59.813624 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:00:59.860334 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7c21b03d-1994-4753-9244-2cacaa9ed736 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.078033 Oct 31 15:00:59.861032 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 280/606] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:00:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:00:59.872029 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-dbd141ea-2254-434c-8d04-9545ee935446 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:00:59.872742 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-dbd141ea-2254-434c-8d04-9545ee935446 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:00:59.928342 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-dbd141ea-2254-434c-8d04-9545ee935446 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:00:59.935459 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-dbd141ea-2254-434c-8d04-9545ee935446 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1238 microversion: 2.1 time: 0.067232 Oct 31 15:00:59.936346 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 327/607] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:00:59 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:00.101440 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:00.102047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:00.108047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:00.109097 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:00.109623 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:00.110317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:00.110759 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:00.111176 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:00.248881 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:00.257492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9ab37003-262a-4858-97b5-031813232fbf tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1727 microversion: 2.1 time: 0.159971 Oct 31 15:01:00.258063 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 281/608] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:00 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:00.279865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f6f2e28f-7eaf-4a04-a7a3-7b2306440998 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:00.280869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f6f2e28f-7eaf-4a04-a7a3-7b2306440998 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:00.286785 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f6f2e28f-7eaf-4a04-a7a3-7b2306440998 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:00.287464 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f6f2e28f-7eaf-4a04-a7a3-7b2306440998 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:00.288151 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f6f2e28f-7eaf-4a04-a7a3-7b2306440998 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:00.288651 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f6f2e28f-7eaf-4a04-a7a3-7b2306440998 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:00.289104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f6f2e28f-7eaf-4a04-a7a3-7b2306440998 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:00.289580 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f6f2e28f-7eaf-4a04-a7a3-7b2306440998 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:00.372622 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f6f2e28f-7eaf-4a04-a7a3-7b2306440998 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096606 Oct 31 15:01:00.373198 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 328/609] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 31 15:01:00 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:00.959953 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:00.960835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:00.967914 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:00.968609 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:00.969110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:00.970051 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:00.970564 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:00.971055 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:01.067252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:01.078973 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-301a2b2f-512e-4864-980d-5bc5eb9171ee tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1290 microversion: 2.1 time: 0.123062 Oct 31 15:01:01.080128 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 282/610] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:00 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1290 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:01.484880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-a7491a37-75e8-471a-a7f9-9a4b990cd873 req-868905a2-c340-4e41-bb36-933828f17a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764f83d2-ab35-4b21-a738-a7f366fddf0e", "tag": "eca3597d-1f0c-4411-bf26-b163a2db64fc"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:01.497645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-a7491a37-75e8-471a-a7f9-9a4b990cd873 req-868905a2-c340-4e41-bb36-933828f17a7d service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:01.498353 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-a7491a37-75e8-471a-a7f9-9a4b990cd873 req-868905a2-c340-4e41-bb36-933828f17a7d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:01.499857 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-a7491a37-75e8-471a-a7f9-9a4b990cd873 req-868905a2-c340-4e41-bb36-933828f17a7d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:01.513101 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-a7491a37-75e8-471a-a7f9-9a4b990cd873 req-868905a2-c340-4e41-bb36-933828f17a7d service nova] Creating event network-changed:eca3597d-1f0c-4411-bf26-b163a2db64fc for instance 764f83d2-ab35-4b21-a738-a7f366fddf0e on hv-cinder-86022 Oct 31 15:01:01.527422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-a7491a37-75e8-471a-a7f9-9a4b990cd873 req-868905a2-c340-4e41-bb36-933828f17a7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047106 Oct 31 15:01:01.536426 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 329/611] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:02.102600 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:02.104097 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:02.111217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:02.111819 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:02.112322 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:02.113094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:02.113782 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:02.114322 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:02.207362 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:02.216998 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-cf158753-b88a-4d55-97af-c4181423b5a7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1296 microversion: 2.1 time: 0.118226 Oct 31 15:01:02.234026 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 283/612] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:02 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1296 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:03.242404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:03.243408 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:03.249899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:03.250385 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:03.250819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:03.251516 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:03.252001 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:03.252425 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:03.402643 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:03.411117 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b222c275-2c16-4c13-94d4-f6eff4d81ac7 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1363 microversion: 2.1 time: 0.173581 Oct 31 15:01:03.411690 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 330/613] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:03 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:03.558239 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-a93e2df2-ec84-4890-929c-dea4a14c3e39 req-fdb4f69e-ab37-47c4-bb31-e725cd184255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764f83d2-ab35-4b21-a738-a7f366fddf0e", "tag": "eca3597d-1f0c-4411-bf26-b163a2db64fc"}, {"name": "network-changed", "server_uuid": "37732b02-4aae-470b-860b-9fce11dbc27d", "tag": "873de307-4df8-44d0-9916-a5145ef5bdb4"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:03.569432 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-a93e2df2-ec84-4890-929c-dea4a14c3e39 req-fdb4f69e-ab37-47c4-bb31-e725cd184255 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:03.569900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-a93e2df2-ec84-4890-929c-dea4a14c3e39 req-fdb4f69e-ab37-47c4-bb31-e725cd184255 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:03.570321 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-a93e2df2-ec84-4890-929c-dea4a14c3e39 req-fdb4f69e-ab37-47c4-bb31-e725cd184255 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:03.583495 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-a93e2df2-ec84-4890-929c-dea4a14c3e39 req-fdb4f69e-ab37-47c4-bb31-e725cd184255 service nova] Creating event network-changed:eca3597d-1f0c-4411-bf26-b163a2db64fc for instance 764f83d2-ab35-4b21-a738-a7f366fddf0e on hv-cinder-86022 Oct 31 15:01:03.584014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-a93e2df2-ec84-4890-929c-dea4a14c3e39 req-fdb4f69e-ab37-47c4-bb31-e725cd184255 service nova] Creating event network-changed:873de307-4df8-44d0-9916-a5145ef5bdb4 for instance 37732b02-4aae-470b-860b-9fce11dbc27d on hv-cinder-86022 Oct 31 15:01:03.590723 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-a93e2df2-ec84-4890-929c-dea4a14c3e39 req-fdb4f69e-ab37-47c4-bb31-e725cd184255 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036368 Oct 31 15:01:03.591309 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 284/614] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:04.434587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:04.435196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:04.442473 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:04.442953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:04.443387 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:04.444097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:04.444547 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:04.444970 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:04.573446 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:04.581491 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-52b63df0-bb76-4c5d-b933-01f32c7afe08 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1363 microversion: 2.1 time: 0.150721 Oct 31 15:01:04.582051 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 331/615] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:04 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:05.606297 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:05.607027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:05.613126 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:05.613642 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:05.614080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:05.614804 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:05.615326 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:05.615782 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:05.749264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:05.756900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7d2e1b1b-a140-4f6c-9781-6d2b6a965640 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1363 microversion: 2.1 time: 0.155643 Oct 31 15:01:05.757459 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 285/616] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:05 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:06.779192 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:06.780418 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:06.786836 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:06.787255 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:06.787729 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:06.788422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:06.788850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:06.789267 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:06.920355 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:06.928100 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-68505a10-be60-4326-8a6d-309ee1a866e5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1363 microversion: 2.1 time: 0.152776 Oct 31 15:01:06.928658 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 332/617] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:06 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:07.660143 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-399e0fd1-14cc-412f-b0a2-a8a982c7266e req-75caa80f-d5a5-4188-a2be-6f818946d6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37732b02-4aae-470b-860b-9fce11dbc27d", "name": "network-vif-plugged", "status": "completed", "tag": "873de307-4df8-44d0-9916-a5145ef5bdb4"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:07.671863 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-399e0fd1-14cc-412f-b0a2-a8a982c7266e req-75caa80f-d5a5-4188-a2be-6f818946d6ee service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:07.672337 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-399e0fd1-14cc-412f-b0a2-a8a982c7266e req-75caa80f-d5a5-4188-a2be-6f818946d6ee service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:07.672760 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-399e0fd1-14cc-412f-b0a2-a8a982c7266e req-75caa80f-d5a5-4188-a2be-6f818946d6ee service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:07.685382 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-399e0fd1-14cc-412f-b0a2-a8a982c7266e req-75caa80f-d5a5-4188-a2be-6f818946d6ee service nova] Creating event network-vif-plugged:873de307-4df8-44d0-9916-a5145ef5bdb4 for instance 37732b02-4aae-470b-860b-9fce11dbc27d on hv-cinder-86022 Oct 31 15:01:07.690257 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-399e0fd1-14cc-412f-b0a2-a8a982c7266e req-75caa80f-d5a5-4188-a2be-6f818946d6ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Oct 31 15:01:07.691109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 286/618] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:07.951262 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:07.951987 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:07.958353 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:07.958824 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:07.959249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:07.959948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:07.960391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:07.960807 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:08.088801 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:08.097153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-be700d23-c499-4525-a8f7-16b7e07b0b61 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1363 microversion: 2.1 time: 0.149869 Oct 31 15:01:08.097719 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 333/619] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:07 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:09.120271 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:09.120974 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:09.128625 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:09.129114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:09.129551 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:09.130243 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:09.130698 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:09.131127 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:09.262367 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:09.270577 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f5a8ebc2-b897-4bcb-bbd3-b4d464e4abe3 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1363 microversion: 2.1 time: 0.154605 Oct 31 15:01:09.271145 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 287/620] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:09 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:10.292796 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:10.293404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:10.295828 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=6 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:10.301639 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:10.302126 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:10.302644 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:10.303337 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:10.303809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:10.304226 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:10.434736 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:10.442329 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1f9202e3-f6ce-42f6-9775-7bed2db9d006 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1549 microversion: 2.1 time: 0.153379 Oct 31 15:01:10.442913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 334/621] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:10 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:10.465260 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5b8bd58d-be16-428b-872a-2eb69465153a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:10.465783 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5b8bd58d-be16-428b-872a-2eb69465153a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:10.468432 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:10.469123 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=6 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:10.475336 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5b8bd58d-be16-428b-872a-2eb69465153a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:10.475850 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5b8bd58d-be16-428b-872a-2eb69465153a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:10.476292 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5b8bd58d-be16-428b-872a-2eb69465153a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:10.476985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5b8bd58d-be16-428b-872a-2eb69465153a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:10.477443 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5b8bd58d-be16-428b-872a-2eb69465153a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:10.477870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5b8bd58d-be16-428b-872a-2eb69465153a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:10.553380 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5b8bd58d-be16-428b-872a-2eb69465153a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091936 Oct 31 15:01:10.553997 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 288/622] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 31 15:01:10 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:11.466807 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-ea7742a3-818b-495e-b37b-751b3953d6f1 req-2145082f-53e1-49ac-a7aa-18b145366b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37732b02-4aae-470b-860b-9fce11dbc27d", "tag": "873de307-4df8-44d0-9916-a5145ef5bdb4"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:11.476534 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-ea7742a3-818b-495e-b37b-751b3953d6f1 req-2145082f-53e1-49ac-a7aa-18b145366b3b service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:11.477000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-ea7742a3-818b-495e-b37b-751b3953d6f1 req-2145082f-53e1-49ac-a7aa-18b145366b3b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:11.477427 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-ea7742a3-818b-495e-b37b-751b3953d6f1 req-2145082f-53e1-49ac-a7aa-18b145366b3b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:11.493041 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-ea7742a3-818b-495e-b37b-751b3953d6f1 req-2145082f-53e1-49ac-a7aa-18b145366b3b service nova] Creating event network-changed:873de307-4df8-44d0-9916-a5145ef5bdb4 for instance 37732b02-4aae-470b-860b-9fce11dbc27d on hv-cinder-86022 Oct 31 15:01:11.498852 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-ea7742a3-818b-495e-b37b-751b3953d6f1 req-2145082f-53e1-49ac-a7aa-18b145366b3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035105 Oct 31 15:01:11.499789 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 335/623] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:39.154358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:39.155233 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:39.160028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-60194761-1df9-4cce-9706-a2e4e9abbef9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:39.160510 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-60194761-1df9-4cce-9706-a2e4e9abbef9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:39.168742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60194761-1df9-4cce-9706-a2e4e9abbef9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:39.169409 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60194761-1df9-4cce-9706-a2e4e9abbef9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:39.169840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60194761-1df9-4cce-9706-a2e4e9abbef9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:39.170522 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60194761-1df9-4cce-9706-a2e4e9abbef9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:39.170969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60194761-1df9-4cce-9706-a2e4e9abbef9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:39.171386 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-60194761-1df9-4cce-9706-a2e4e9abbef9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:39.196099 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-60194761-1df9-4cce-9706-a2e4e9abbef9 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/ips" status: 200 len: 152 microversion: 2.20 time: 0.043292 Oct 31 15:01:39.196659 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 289/624] 10.222.0.36 () {60 vars in 1289 bytes} [Mon Oct 31 15:01:39 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:01:40.292885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:40.293616 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=94 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:40.298053 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:40.298657 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:40.306921 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:40.307400 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:40.307868 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:40.308560 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:40.309011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:40.309435 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:40.546970 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lazy-loading 'services' on Instance uuid 764f83d2-ab35-4b21-a738-a7f366fddf0e {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:01:40.618840 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b989420f-5f80-4d82-8f0d-183ff322ddda tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments/10348efa-808b-4ddf-85c4-10452d32ecc2" status: 202 len: 0 microversion: 2.1 time: 0.327422 Oct 31 15:01:40.619527 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 336/625] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:01:40 2022] DELETE /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments/10348efa-808b-4ddf-85c4-10452d32ecc2 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:01:40.628609 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c515d15f-62e6-47ea-80d6-d4004b6f85ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:40.631491 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c515d15f-62e6-47ea-80d6-d4004b6f85ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:40.639164 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c515d15f-62e6-47ea-80d6-d4004b6f85ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:40.639677 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c515d15f-62e6-47ea-80d6-d4004b6f85ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:40.640111 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c515d15f-62e6-47ea-80d6-d4004b6f85ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:40.640818 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c515d15f-62e6-47ea-80d6-d4004b6f85ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:40.641430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c515d15f-62e6-47ea-80d6-d4004b6f85ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:40.641846 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c515d15f-62e6-47ea-80d6-d4004b6f85ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:40.671576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c515d15f-62e6-47ea-80d6-d4004b6f85ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046822 Oct 31 15:01:40.672136 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 290/626] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:01:40 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:01:40.947399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:40.948040 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:40.955085 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:40.955582 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:40.956023 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:40.956712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:40.957161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:40.957582 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:40.979379 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lazy-loading 'flavor' on Instance uuid e78da101-dab9-43eb-b75d-14baee21f5c0 {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:01:41.203621 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7199642e-d4ae-45cb-98fc-912419801abb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/action" status: 202 len: 0 microversion: 2.20 time: 0.260276 Oct 31 15:01:41.204153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 337/627] 10.222.0.36 () {62 vars in 1319 bytes} [Mon Oct 31 15:01:40 2022] POST /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:01:41.212289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:41.212893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:41.218754 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:41.219224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:41.219676 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:41.220348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:41.220816 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:41.221211 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:41.684975 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6e05f517-0f87-4d26-8076-8f8eae3261bc tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:41.687305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6e05f517-0f87-4d26-8076-8f8eae3261bc tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:41.694746 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e05f517-0f87-4d26-8076-8f8eae3261bc tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:41.695235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e05f517-0f87-4d26-8076-8f8eae3261bc tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:41.695704 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e05f517-0f87-4d26-8076-8f8eae3261bc tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:41.696549 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e05f517-0f87-4d26-8076-8f8eae3261bc tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:41.696998 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e05f517-0f87-4d26-8076-8f8eae3261bc tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:41.697570 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e05f517-0f87-4d26-8076-8f8eae3261bc tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:41.728394 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6e05f517-0f87-4d26-8076-8f8eae3261bc tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048311 Oct 31 15:01:41.728850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 338/628] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:01:41 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:01:41.761979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:41.771160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:41.772833 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:41.774765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-aacdc5c2-a707-45c1-b8f3-5a48d738bc8c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.566207 Oct 31 15:01:41.775393 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 291/629] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:41 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:01:41.808013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:41.808543 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:41.814444 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:41.814927 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:41.815598 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:41.816275 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:41.816719 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:41.817140 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:41.844078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Going to try to terminate instance {{(pid=134339) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:01:41.924972 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5e9336cc-6042-4ec0-9ddd-173dd3c88542 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 204 len: 0 microversion: 2.1 time: 0.120479 Oct 31 15:01:41.925918 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 339/630] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:01:41 2022] DELETE /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:01:41.934387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:41.935002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:41.941327 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:41.941812 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:41.942244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:41.942932 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:41.943381 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:41.943835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:42.070758 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:42.079319 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-bccabaaa-9550-4138-9699-17f57d003ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1687 microversion: 2.1 time: 0.149090 Oct 31 15:01:42.079918 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 292/631] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:41 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:42.152990 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8bcf0d60-6fb7-4a7b-9520-84d420cde7d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:42.153595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8bcf0d60-6fb7-4a7b-9520-84d420cde7d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:42.159458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8bcf0d60-6fb7-4a7b-9520-84d420cde7d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:42.159966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8bcf0d60-6fb7-4a7b-9520-84d420cde7d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:42.160400 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8bcf0d60-6fb7-4a7b-9520-84d420cde7d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:42.161088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8bcf0d60-6fb7-4a7b-9520-84d420cde7d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:42.161536 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8bcf0d60-6fb7-4a7b-9520-84d420cde7d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:42.161985 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8bcf0d60-6fb7-4a7b-9520-84d420cde7d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:42.185242 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8bcf0d60-6fb7-4a7b-9520-84d420cde7d3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/ips" status: 200 len: 147 microversion: 2.1 time: 0.036549 Oct 31 15:01:42.185807 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 340/632] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 15:01:42 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:01:42.856440 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:42.857114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:42.863037 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:42.863514 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:42.864047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:42.864680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:42.865113 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:42.865562 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:42.995961 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:43.004044 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:43.005521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:43.006675 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-edea6390-f7c8-4974-8508-ddda0d0ef899 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.209801 Oct 31 15:01:43.007227 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 293/633] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:42 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:43.103649 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:43.104207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:43.111221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:43.111731 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:43.112169 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:43.112850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:43.113300 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:43.113724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:43.243925 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:43.251568 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6255e0a1-2e93-4822-9c08-f22bd7ae79c4 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1687 microversion: 2.1 time: 0.151821 Oct 31 15:01:43.252127 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 341/634] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:43 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:43.517420 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4d5ba398-c888-49da-b011-1d02fe7c4a5c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "271faa23-d15c-47cd-9c65-baf5eaf8d63e"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:43.519858 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4d5ba398-c888-49da-b011-1d02fe7c4a5c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:43.526102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d5ba398-c888-49da-b011-1d02fe7c4a5c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:43.526584 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d5ba398-c888-49da-b011-1d02fe7c4a5c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:43.527734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d5ba398-c888-49da-b011-1d02fe7c4a5c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:43.528316 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d5ba398-c888-49da-b011-1d02fe7c4a5c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:43.528770 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d5ba398-c888-49da-b011-1d02fe7c4a5c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:43.529206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d5ba398-c888-49da-b011-1d02fe7c4a5c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:44.031744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:44.032354 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:44.038320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:44.038797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:44.039234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:44.039968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:44.040417 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:44.040835 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:44.170431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:44.178453 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:44.179932 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:44.181090 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5a2b8f61-5960-46fd-88c2-20b45fb92ad2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.153312 Oct 31 15:01:44.181639 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 342/635] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:44 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:01:44.275002 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:44.275628 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:44.281411 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:44.281939 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:44.282328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:44.283013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:44.283465 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:44.283912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:44.410552 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:44.419300 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-51708b0d-29cb-40b4-bbfc-85b7a0c878e2 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1687 microversion: 2.1 time: 0.147991 Oct 31 15:01:44.419903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 343/636] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:44 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1687 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:45.208608 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:45.209394 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:45.215857 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:45.216413 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:45.216763 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:45.217457 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:45.217908 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:45.218322 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:45.366659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:45.376279 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:45.377876 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:45.379058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1b6c9780-aa8e-42ac-8b88-c3652ff36462 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.174473 Oct 31 15:01:45.379642 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 344/637] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:45 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:01:45.382523 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4d5ba398-c888-49da-b011-1d02fe7c4a5c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.868793 Oct 31 15:01:45.389150 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 294/638] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:01:43 2022] POST /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments => generated 194 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:45.442311 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:45.443820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:45.452555 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:45.453344 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:45.453782 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:45.454511 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:45.454964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:45.455384 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:45.598243 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:45.606575 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4d86511b-3a80-432a-9467-ef6395db0458 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1687 microversion: 2.1 time: 0.168184 Oct 31 15:01:45.607074 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 345/639] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:45 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:46.406870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:46.407724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:46.413843 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:46.414415 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:46.414851 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:46.415562 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:46.416024 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:46.416454 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:46.523874 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-9af6c1b9-0807-4e91-b921-326180baaa4d req-45c3b37c-ab4c-4e71-b40f-bf73af858466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764f83d2-ab35-4b21-a738-a7f366fddf0e", "name": "network-vif-deleted", "tag": "eca3597d-1f0c-4411-bf26-b163a2db64fc"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:46.539071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9af6c1b9-0807-4e91-b921-326180baaa4d req-45c3b37c-ab4c-4e71-b40f-bf73af858466 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:46.539926 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9af6c1b9-0807-4e91-b921-326180baaa4d req-45c3b37c-ab4c-4e71-b40f-bf73af858466 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:46.540462 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9af6c1b9-0807-4e91-b921-326180baaa4d req-45c3b37c-ab4c-4e71-b40f-bf73af858466 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:46.558177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-9af6c1b9-0807-4e91-b921-326180baaa4d req-45c3b37c-ab4c-4e71-b40f-bf73af858466 service nova] Creating event network-vif-deleted:eca3597d-1f0c-4411-bf26-b163a2db64fc for instance 764f83d2-ab35-4b21-a738-a7f366fddf0e on hv-cinder-86022 Oct 31 15:01:46.566063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-9af6c1b9-0807-4e91-b921-326180baaa4d req-45c3b37c-ab4c-4e71-b40f-bf73af858466 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046637 Oct 31 15:01:46.566956 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 346/640] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:01:46.615802 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:46.626028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:46.627862 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:46.629489 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5c9b6787-a95c-4890-a459-f2fb1ad072c3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.227451 Oct 31 15:01:46.630620 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 295/641] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:46 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:46.632198 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:46.633155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:46.653663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:46.654448 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:46.655075 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:46.655976 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:46.656589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:46.657170 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:46.733531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:46.743484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-06ccdcd0-e959-40e0-b783-526c0b712ff1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 200 len: 1330 microversion: 2.1 time: 0.116939 Oct 31 15:01:46.745034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 347/642] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:46 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:47.654990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:47.655616 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:47.661976 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:47.662454 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:47.662883 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:47.663775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:47.664351 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:47.664894 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:47.767775 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:47.768616 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: 764f83d2-ab35-4b21-a738-a7f366fddf0e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:47.775834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:47.776322 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:47.776863 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:47.777746 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:47.778198 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:47.778624 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:47.791964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] HTTP exception thrown: Instance 764f83d2-ab35-4b21-a738-a7f366fddf0e could not be found. Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Request method failure captured: Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e HTTP/1.1 Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0WnXqVoGMkFGjruLglgKS6_fArFbovBTxoWqr2QtwCJEYLprU_tgF4EvTk2yZ_Ect21eHEtFnbIgXByF8FVTVtCG8v209_WYKdYErkOZa0vfsIIuJNfSVDMtha-xW8HjXq9pOJI89chFU9Eyu0QEvuKNGXqm9Kcfdj--tVnG-Ne4 Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:01:47.794234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8bc7c0eaebf146bea1af6b4d708bf62b"}]}] Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: e6bfe2c1ba054935ae8e9fcc054faf68 Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 764f83d2-ab35-4b21-a738-a7f366fddf0e could not be found. Oct 31 15:01:47.795819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '764f83d2-ab35-4b21-a738-a7f366fddf0e'} Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 764f83d2-ab35-4b21-a738-a7f366fddf0e could not be found. Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:01:47.796631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 764f83d2-ab35-4b21-a738-a7f366fddf0e could not be found. Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 764f83d2-ab35-4b21-a738-a7f366fddf0e could not be found. Oct 31 15:01:47.798054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:47.799295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Returning 404 to user: Instance 764f83d2-ab35-4b21-a738-a7f366fddf0e could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:01:47.799295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ecde21a5-26f1-4095-add0-c13514404a2b tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e" status: 404 len: 111 microversion: 2.1 time: 0.031765 Oct 31 15:01:47.799295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 348/643] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:47 2022] GET /compute/v2.1/servers/764f83d2-ab35-4b21-a738-a7f366fddf0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:01:47.803874 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-89ad608e-c691-4174-a6dc-3f23aa00a244 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '.version_select at 0x7f6c70e2a040>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:47.807117 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:47.816578 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:47.817952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:47.819295 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0729c619-25d9-40d7-abd0-eeb1a1328e09 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.168101 Oct 31 15:01:47.820054 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 296/644] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:47 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:47.824600 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-89ad608e-c691-4174-a6dc-3f23aa00a244 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-412097319" status: 202 len: 0 microversion: 2.1 time: 0.024126 Oct 31 15:01:47.825198 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 349/645] 10.222.0.36 () {58 vars in 1218 bytes} [Mon Oct 31 15:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-412097319 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:01:48.846457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:48.847071 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:48.853527 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:48.854010 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:48.854445 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:48.855376 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:48.855663 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:48.856092 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:48.987782 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:48.996485 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:48.997939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:48.999104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-101f30c1-e0ed-49d3-bc2b-668e52fbbb08 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.156539 Oct 31 15:01:48.999803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 297/646] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:48 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:50.025341 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:50.025946 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:50.034709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:50.035191 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:50.035655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:50.036343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:50.036794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:50.037216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:50.167830 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:50.171314 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:50.177002 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:50.178426 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:50.179655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8a6f193b-3661-4b12-8912-71055b617361 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.158657 Oct 31 15:01:50.180207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 350/647] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:50 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:50.693490 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:50.693983 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:50.701576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:50.702017 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:50.702378 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:50.703103 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:50.703544 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:50.704007 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:50.728559 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:01:50.805579 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-09290b93-cbc1-490b-a79a-81553031418f tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 204 len: 0 microversion: 2.1 time: 0.115660 Oct 31 15:01:50.806270 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 298/648] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:01:50 2022] DELETE /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:01:50.815973 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:50.816587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:50.824105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:50.824584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:50.825016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:50.825702 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:50.826153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:50.826572 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:50.954006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:50.961704 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-80bb200c-eab9-4193-9b2d-3432c6fa48ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1506 microversion: 2.1 time: 0.149604 Oct 31 15:01:50.962255 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 351/649] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:50 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:51.205274 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:51.206000 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:51.211874 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:51.212347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:51.212779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:51.213456 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:51.214441 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:51.215086 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:51.348213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:51.356964 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:51.358411 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:51.359572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-79d112d1-9699-467d-8d4e-183a07a9086c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.158546 Oct 31 15:01:51.360134 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 299/650] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:51 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:51.985012 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:51.985623 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:51.992266 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:51.992743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:51.993174 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:51.993859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:51.994305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:51.994723 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:52.119756 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:52.127767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ea387216-c207-47c6-9230-1759e9ce5366 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1506 microversion: 2.1 time: 0.146576 Oct 31 15:01:52.128320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 352/651] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:51 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:52.385217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:52.385753 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:52.392149 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:52.392629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:52.393059 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:52.393742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:52.394188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:52.394606 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:52.519960 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:52.528100 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:52.529543 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:52.530700 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e8db7ed3-a9ca-498e-a4d8-36ead3b23d50 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.149535 Oct 31 15:01:52.531516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 300/652] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:52 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:53.152140 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:53.152747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:53.159105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:53.159601 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:53.160038 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:53.160722 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:53.161171 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:53.161589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:53.291346 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:53.299314 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8c3e4075-54c1-4c8d-ace1-c1a2bad36cba tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1506 microversion: 2.1 time: 0.151827 Oct 31 15:01:53.299902 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 353/653] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:53 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:53.556905 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:53.558124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:53.564526 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:53.564999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:53.565427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:53.566103 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:53.566548 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:53.566966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:53.699438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:53.709112 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:53.710948 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:53.712036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9518e478-0ea5-41cd-92de-1abbe765cd04 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.158981 Oct 31 15:01:53.713014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 301/654] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:53 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:54.006341 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "271faa23-d15c-47cd-9c65-baf5eaf8d63e"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:54.008793 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:54.015097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.015603 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.016045 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.016744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.017193 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.017624 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.099135 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Invalid volume: volume 271faa23-d15c-47cd-9c65-baf5eaf8d63e is already attached to instances: 9357fbec-cc10-4069-9fa4-fdeefcbe705b Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: POST /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments HTTP/1.1 Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 74 Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:01:54.100767 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {"volumeAttachment": {"volumeId": "271faa23-d15c-47cd-9c65-baf5eaf8d63e"}} Oct 31 15:01:54.102235 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Invalid volume: volume 271faa23-d15c-47cd-9c65-baf5eaf8d63e is already attached to instances: 9357fbec-cc10-4069-9fa4-fdeefcbe705b Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'server_id': '9357fbec-cc10-4069-9fa4-fdeefcbe705b', 'body': {'volumeAttachment': {'volumeId': '271faa23-d15c-47cd-9c65-baf5eaf8d63e'}}} Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 271faa23-d15c-47cd-9c65-baf5eaf8d63e is already attached to instances: 9357fbec-cc10-4069-9fa4-fdeefcbe705b Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:54.107260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 271faa23-d15c-47cd-9c65-baf5eaf8d63e is already attached to instances: 9357fbec-cc10-4069-9fa4-fdeefcbe705b Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:54.108477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:54.110445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:54.110445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:01:54.110445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:01:54.110445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 271faa23-d15c-47cd-9c65-baf5eaf8d63e is already attached to instances: 9357fbec-cc10-4069-9fa4-fdeefcbe705b Oct 31 15:01:54.110445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:54.110445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 400 to user: Invalid volume: volume 271faa23-d15c-47cd-9c65-baf5eaf8d63e is already attached to instances: 9357fbec-cc10-4069-9fa4-fdeefcbe705b {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:01:54.110445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-619fd206-2e58-4ffa-9c39-c37345291518 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099778 Oct 31 15:01:54.110445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 354/655] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:01:54 2022] POST /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:01:54.180733 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:54.181224 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:54.188105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.188866 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.189496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.190394 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.191001 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.191672 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.194098 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-d8c43c1e-0552-44b1-a7e6-bbeff6d62295 req-d48c0f4e-0270-4f22-bb6a-cf4ee64c1c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e71890-419f-41a8-8e60-cd53d110c7ba", "name": "network-vif-deleted", "tag": "6bb7edab-168d-4a77-a2bd-14d7c9e243e8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:54.218304 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-d8c43c1e-0552-44b1-a7e6-bbeff6d62295 req-d48c0f4e-0270-4f22-bb6a-cf4ee64c1c01 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.218704 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-d8c43c1e-0552-44b1-a7e6-bbeff6d62295 req-d48c0f4e-0270-4f22-bb6a-cf4ee64c1c01 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.219136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-d8c43c1e-0552-44b1-a7e6-bbeff6d62295 req-d48c0f4e-0270-4f22-bb6a-cf4ee64c1c01 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.231944 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-d8c43c1e-0552-44b1-a7e6-bbeff6d62295 req-d48c0f4e-0270-4f22-bb6a-cf4ee64c1c01 service nova] Creating event network-vif-deleted:6bb7edab-168d-4a77-a2bd-14d7c9e243e8 for instance c9e71890-419f-41a8-8e60-cd53d110c7ba on hv-cinder-86022 Oct 31 15:01:54.238431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-d8c43c1e-0552-44b1-a7e6-bbeff6d62295 req-d48c0f4e-0270-4f22-bb6a-cf4ee64c1c01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047828 Oct 31 15:01:54.241034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 355/656] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:01:54.282585 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:54.286999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lazy-loading 'services' on Instance uuid 9357fbec-cc10-4069-9fa4-fdeefcbe705b {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:01:54.324270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:54.325046 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:54.331151 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.331662 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.332156 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.332988 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.333430 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.334032 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.368734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-88a3c459-5c99-4103-b776-2f8fdd17a5e3 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments/271faa23-d15c-47cd-9c65-baf5eaf8d63e" status: 202 len: 0 microversion: 2.1 time: 0.191859 Oct 31 15:01:54.369990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 302/657] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:01:54 2022] DELETE /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments/271faa23-d15c-47cd-9c65-baf5eaf8d63e => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:01:54.373498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.373989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.374422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.374899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lazy-loading 'fault' on Instance uuid c9e71890-419f-41a8-8e60-cd53d110c7ba {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:01:54.378870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4e15c897-1cb6-4814-b0c1-276605331f9d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:54.381429 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4e15c897-1cb6-4814-b0c1-276605331f9d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:54.388492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e15c897-1cb6-4814-b0c1-276605331f9d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.389587 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e15c897-1cb6-4814-b0c1-276605331f9d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.390077 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e15c897-1cb6-4814-b0c1-276605331f9d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.390837 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e15c897-1cb6-4814-b0c1-276605331f9d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.391289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e15c897-1cb6-4814-b0c1-276605331f9d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.391803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e15c897-1cb6-4814-b0c1-276605331f9d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.424502 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4e15c897-1cb6-4814-b0c1-276605331f9d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050102 Oct 31 15:01:54.425067 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 303/658] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:01:54 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:01:54.437055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:54.445748 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4c70b280-b818-4128-b4aa-a244f19987df tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 200 len: 1310 microversion: 2.1 time: 0.126894 Oct 31 15:01:54.446306 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 356/659] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:54 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 1310 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:54.741131 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:54.741688 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:54.749260 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.749776 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.750213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.750913 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.751369 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.751828 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.887646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:54.895796 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:54.897270 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:54.898464 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0b1685ff-327b-4c62-8da0-498ffb4f4e76 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.161324 Oct 31 15:01:54.899001 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 304/660] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:54 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:54.899712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c02b5147-c84b-48f5-8505-7273ca1276ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:54.900212 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c02b5147-c84b-48f5-8505-7273ca1276ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:54.906303 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c02b5147-c84b-48f5-8505-7273ca1276ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.906812 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c02b5147-c84b-48f5-8505-7273ca1276ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.907252 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c02b5147-c84b-48f5-8505-7273ca1276ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.907973 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c02b5147-c84b-48f5-8505-7273ca1276ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:54.908432 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c02b5147-c84b-48f5-8505-7273ca1276ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:54.908859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c02b5147-c84b-48f5-8505-7273ca1276ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:54.931624 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c02b5147-c84b-48f5-8505-7273ca1276ef tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/ips" status: 200 len: 145 microversion: 2.1 time: 0.094136 Oct 31 15:01:54.932166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 357/661] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 15:01:54 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/ips => generated 145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:01:55.437928 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6915f5f5-3e08-4bf0-a781-2f645ce8eb1e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:55.440186 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6915f5f5-3e08-4bf0-a781-2f645ce8eb1e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:55.446171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6915f5f5-3e08-4bf0-a781-2f645ce8eb1e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.446748 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6915f5f5-3e08-4bf0-a781-2f645ce8eb1e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.447227 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6915f5f5-3e08-4bf0-a781-2f645ce8eb1e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.448045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6915f5f5-3e08-4bf0-a781-2f645ce8eb1e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.448980 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6915f5f5-3e08-4bf0-a781-2f645ce8eb1e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.449390 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6915f5f5-3e08-4bf0-a781-2f645ce8eb1e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.471915 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:55.473640 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: c9e71890-419f-41a8-8e60-cd53d110c7ba] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:55.480124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6915f5f5-3e08-4bf0-a781-2f645ce8eb1e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045535 Oct 31 15:01:55.486221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 305/662] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:01:55 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:01:55.486781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.486781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.486781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.486781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.487139 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.487139 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.499897 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] HTTP exception thrown: Instance c9e71890-419f-41a8-8e60-cd53d110c7ba could not be found. Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Request method failure captured: Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba HTTP/1.1 Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0WnXqVoGMkFGjruLglgKS6_fArFbovBTxoWqr2QtwCJEYLprU_tgF4EvTk2yZ_Ect21eHEtFnbIgXByF8FVTVtCG8v209_WYKdYErkOZa0vfsIIuJNfSVDMtha-xW8HjXq9pOJI89chFU9Eyu0QEvuKNGXqm9Kcfdj--tVnG-Ne4 Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:01:55.501783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8bc7c0eaebf146bea1af6b4d708bf62b"}]}] Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: e6bfe2c1ba054935ae8e9fcc054faf68 Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance c9e71890-419f-41a8-8e60-cd53d110c7ba could not be found. Oct 31 15:01:55.503292 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': 'c9e71890-419f-41a8-8e60-cd53d110c7ba'} Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e71890-419f-41a8-8e60-cd53d110c7ba could not be found. Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:01:55.504130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e71890-419f-41a8-8e60-cd53d110c7ba could not be found. Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e71890-419f-41a8-8e60-cd53d110c7ba could not be found. Oct 31 15:01:55.505294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:01:55.506320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Returning 404 to user: Instance c9e71890-419f-41a8-8e60-cd53d110c7ba could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:01:55.506320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-61e00475-6df5-4968-91dd-1d72ccef63c8 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba" status: 404 len: 111 microversion: 2.1 time: 0.035137 Oct 31 15:01:55.506320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 358/663] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:55 2022] GET /compute/v2.1/servers/c9e71890-419f-41a8-8e60-cd53d110c7ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:01:55.512111 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:55.512611 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:55.518637 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.519127 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.519621 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.520328 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.520787 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.521215 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.553658 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:55.554006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:55.555742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:01:55.560324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.560950 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.561611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.562401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.562943 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.563455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.593555 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Going to try to terminate instance {{(pid=134339) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:01:55.634940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-42c1f763-1f32-4262-9a82-39296db47781 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 204 len: 0 microversion: 2.1 time: 0.126394 Oct 31 15:01:55.636171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 306/664] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:01:55 2022] DELETE /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:01:55.645362 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:55.646188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:55.653447 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.653929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.654364 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.655048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.655492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.655962 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.674234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8ada2c1b-733e-4697-a025-58cad149f8e8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 204 len: 0 microversion: 2.1 time: 0.125545 Oct 31 15:01:55.675231 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 359/665] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:01:55 2022] DELETE /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:01:55.684386 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:55.685078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:55.691024 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.691499 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.691958 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.692642 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.693088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.693507 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.795795 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:55.803468 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-28dd4796-c359-4633-89ae-f39bc92d6588 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.162422 Oct 31 15:01:55.803999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 307/666] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:55 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:55.834259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:55.842428 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-deb23e54-6b47-4557-a5a6-063ff2185f95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1678 microversion: 2.1 time: 0.162992 Oct 31 15:01:55.842981 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 360/667] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:55 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:55.923911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:55.924517 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:55.930355 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.930824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.931266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:55.931953 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:55.932468 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:55.932890 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:56.061427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:56.069482 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:56.070911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:56.072085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9b3db6ae-7a75-4456-8286-ede93d07bac7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.152035 Oct 31 15:01:56.072635 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 308/668] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:55 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:56.271176 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-bc872a44-a946-4b61-863c-3ed21d617e37 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cdf662b-310c-4889-b941-1374f1c8e161"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:01:56.273598 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-bc872a44-a946-4b61-863c-3ed21d617e37 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:56.280231 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bc872a44-a946-4b61-863c-3ed21d617e37 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:56.280707 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bc872a44-a946-4b61-863c-3ed21d617e37 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:56.281135 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bc872a44-a946-4b61-863c-3ed21d617e37 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:56.281814 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bc872a44-a946-4b61-863c-3ed21d617e37 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:56.282262 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bc872a44-a946-4b61-863c-3ed21d617e37 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:56.282682 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-bc872a44-a946-4b61-863c-3ed21d617e37 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:56.827900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:56.828701 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:56.836909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:56.837390 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:56.837818 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:56.838507 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:56.839128 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:56.839642 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:56.966207 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:56.974014 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f3268e80-3709-41ae-9286-6a0c79b8f1ef tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.151072 Oct 31 15:01:56.974586 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 309/669] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:56 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:56.978908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:56.980213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:56.985673 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:56.986144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:56.986571 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:56.987244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:56.987714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:56.988131 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:57.113237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:57.120808 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8de3131f-1f17-4eb5-95fd-d0074af97c53 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1678 microversion: 2.1 time: 0.145292 Oct 31 15:01:57.121363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 310/670] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:56 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:57.125648 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:57.126244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:57.131698 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:57.132171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:57.132601 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:57.133275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:57.133720 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:57.134132 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:57.263162 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:57.271196 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:57.272671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:57.273821 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4d38b927-f0f7-4001-846c-d9bcca313089 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.151562 Oct 31 15:01:57.274374 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 311/671] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:57 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:57.998368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:57.999027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:58.005349 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:58.005820 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:58.006248 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:58.006931 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:58.007374 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:58.007832 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:58.134768 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:58.143281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-99ebd69b-2c9f-4f3a-9563-9839952593ff tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.149688 Oct 31 15:01:58.143873 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 312/672] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:57 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:58.148179 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:58.148778 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:58.154747 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:58.155226 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:58.155681 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:58.156370 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:58.156817 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:58.157238 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:58.287391 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:58.296855 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3bf147cf-62d0-49a4-941b-a6e80ce004de tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1678 microversion: 2.1 time: 0.151978 Oct 31 15:01:58.297434 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 313/673] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:58 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:01:58.301935 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:58.302649 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:58.311264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:58.311769 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:58.312199 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:58.312882 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:58.313324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:58.313735 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:58.442839 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:58.451454 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:58.452937 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:58.454105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-79d052ce-18ba-4766-a679-b1600aa26925 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.155759 Oct 31 15:01:58.454663 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 314/674] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:58 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:59.166437 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:59.167206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:59.173522 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:59.174002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:59.174433 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:59.175114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:59.175586 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:59.176002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:59.305360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:59.313883 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a6bc311f-1bbe-4c69-bdf5-d1ac7791cc9a tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.151259 Oct 31 15:01:59.314452 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 315/675] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:59 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:59.320656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:59.321251 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:59.327854 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:59.328337 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:59.328762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:59.329433 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:59.329877 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:59.330290 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:59.455788 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:59.463409 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-edd25a03-efbe-414c-9492-1d8955a501c0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1678 microversion: 2.1 time: 0.146174 Oct 31 15:01:59.463988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 316/676] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:01:59 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:01:59.483027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:01:59.483665 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:01:59.489361 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:59.489832 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:59.490253 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:59.490951 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:01:59.491391 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:01:59.491828 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:01:59.496395 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:59.622397 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:59.630394 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:59.631876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:01:59.633049 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-34f53fa5-dc49-4eff-828a-9be3b2bf2daf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.153980 Oct 31 15:01:59.633608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 317/677] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:01:59 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:01:59.996869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-bc872a44-a946-4b61-863c-3ed21d617e37 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.729133 Oct 31 15:01:59.997485 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 361/678] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:01:56 2022] POST /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments => generated 194 bytes in 3731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:00.336965 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:00.338857 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:00.345569 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:00.346059 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:00.346510 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:00.347256 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:00.347829 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:00.348268 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:00.488708 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:00.489319 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:00.495527 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:00.496054 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:00.496499 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:00.497178 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:00.497622 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:00.498040 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:00.630375 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:00.638816 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-459f9090-4509-4c95-bcdd-53dffecc3b70 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1678 microversion: 2.1 time: 0.155502 Oct 31 15:02:00.639470 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 362/679] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:00 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:02:00.658732 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:00.659348 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:00.668341 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:00.668866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:00.669304 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:00.670013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:00.670466 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:00.670879 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:00.672076 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bfe2c1ba054935ae8e9fcc054faf68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc7c0eaebf146bea1af6b4d708bf62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:00.681721 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3cd0ee11-db3d-49e4-9a9f-b03570eac4c1 tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 200 len: 1521 microversion: 2.1 time: 0.348489 Oct 31 15:02:00.699601 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 318/680] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:00 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:00.775690 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-6d7f75ea-f656-4587-8507-46bf5c0579fc req-f3e588f9-6e0a-4ad9-872a-fdea5d29f01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e52643-da13-4beb-85c9-fd94d0330a8b", "name": "network-vif-deleted", "tag": "4b76563d-9e42-4d52-990e-24dd9cbbde04"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:00.790036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-6d7f75ea-f656-4587-8507-46bf5c0579fc req-f3e588f9-6e0a-4ad9-872a-fdea5d29f01b service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:00.790799 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-6d7f75ea-f656-4587-8507-46bf5c0579fc req-f3e588f9-6e0a-4ad9-872a-fdea5d29f01b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:00.792171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-6d7f75ea-f656-4587-8507-46bf5c0579fc req-f3e588f9-6e0a-4ad9-872a-fdea5d29f01b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:00.805363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-6d7f75ea-f656-4587-8507-46bf5c0579fc req-f3e588f9-6e0a-4ad9-872a-fdea5d29f01b service nova] Creating event network-vif-deleted:4b76563d-9e42-4d52-990e-24dd9cbbde04 for instance b8e52643-da13-4beb-85c9-fd94d0330a8b on hv-cinder-86022 Oct 31 15:02:00.811855 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-6d7f75ea-f656-4587-8507-46bf5c0579fc req-f3e588f9-6e0a-4ad9-872a-fdea5d29f01b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042707 Oct 31 15:02:00.812628 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 319/681] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:02:00.817938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:00.835437 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:00.840969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:00.842447 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8592cd75-3ce5-4969-b589-fc8b47fd823c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1745 microversion: 2.20 time: 0.187566 Oct 31 15:02:00.843102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 363/682] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:00 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:02:01.663408 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:01.664156 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:01.676916 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:01.677726 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:01.678503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:01.679363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:01.679998 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:01.680576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:01.708439 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:01.709052 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] [instance: b8e52643-da13-4beb-85c9-fd94d0330a8b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:01.717008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:01.717755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:01.718606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:01.720019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:01.720694 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:01.721327 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:01.723401 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:01.723923 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:01.724360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:01.724880 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lazy-loading 'fault' on Instance uuid 9357fbec-cc10-4069-9fa4-fdeefcbe705b {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:02:01.742206 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] HTTP exception thrown: Instance b8e52643-da13-4beb-85c9-fd94d0330a8b could not be found. Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Request method failure captured: Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b HTTP/1.1 Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0WnXqVoGMkFGjruLglgKS6_fArFbovBTxoWqr2QtwCJEYLprU_tgF4EvTk2yZ_Ect21eHEtFnbIgXByF8FVTVtCG8v209_WYKdYErkOZa0vfsIIuJNfSVDMtha-xW8HjXq9pOJI89chFU9Eyu0QEvuKNGXqm9Kcfdj--tVnG-Ne4 Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:02:01.744390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8bc7c0eaebf146bea1af6b4d708bf62b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8bc7c0eaebf146bea1af6b4d708bf62b"}]}] Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 8bc7c0eaebf146bea1af6b4d708bf62b Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1144913496 Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: e6bfe2c1ba054935ae8e9fcc054faf68 Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1144913496-project Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance b8e52643-da13-4beb-85c9-fd94d0330a8b could not be found. Oct 31 15:02:01.746381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': 'b8e52643-da13-4beb-85c9-fd94d0330a8b'} Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e52643-da13-4beb-85c9-fd94d0330a8b could not be found. Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:02:01.747069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e52643-da13-4beb-85c9-fd94d0330a8b could not be found. Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e52643-da13-4beb-85c9-fd94d0330a8b could not be found. Oct 31 15:02:01.748236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:01.750779 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] Returning 404 to user: Instance b8e52643-da13-4beb-85c9-fd94d0330a8b could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:02:01.751756 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7ad7fc2d-d44c-4dbe-9444-205f6314f13e tempest-ServerRescueNegativeTestJSON-1144913496 tempest-ServerRescueNegativeTestJSON-1144913496-project] 10.222.0.36 "GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b" status: 404 len: 111 microversion: 2.1 time: 0.047626 Oct 31 15:02:01.757394 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 364/683] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:01 2022] GET /compute/v2.1/servers/b8e52643-da13-4beb-85c9-fd94d0330a8b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:02:01.781723 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-4a9313f1-c536-4a41-beea-c9f0d021d688 req-cc32fef8-176d-49fb-b1d0-d0c9aad29bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78da101-dab9-43eb-b75d-14baee21f5c0", "name": "network-vif-plugged", "status": "completed", "tag": "fad9b881-1f6a-40eb-9847-b09fa756357c"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:01.806746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:01.809086 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-4a9313f1-c536-4a41-beea-c9f0d021d688 req-cc32fef8-176d-49fb-b1d0-d0c9aad29bd1 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:01.813578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-4a9313f1-c536-4a41-beea-c9f0d021d688 req-cc32fef8-176d-49fb-b1d0-d0c9aad29bd1 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:01.814504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-4a9313f1-c536-4a41-beea-c9f0d021d688 req-cc32fef8-176d-49fb-b1d0-d0c9aad29bd1 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:01.817174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9c7ff722-a660-463b-8070-c4f2bec48d6f tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 200 len: 1331 microversion: 2.1 time: 0.158465 Oct 31 15:02:01.818149 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 320/684] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:01 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 1331 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:01.846375 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-4a9313f1-c536-4a41-beea-c9f0d021d688 req-cc32fef8-176d-49fb-b1d0-d0c9aad29bd1 service nova] Creating event network-vif-plugged:fad9b881-1f6a-40eb-9847-b09fa756357c for instance e78da101-dab9-43eb-b75d-14baee21f5c0 on hv-cinder-86022 Oct 31 15:02:01.852870 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-4a9313f1-c536-4a41-beea-c9f0d021d688 req-cc32fef8-176d-49fb-b1d0-d0c9aad29bd1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076325 Oct 31 15:02:01.853955 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 365/685] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:01.871154 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:01.872582 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:01.880152 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:01.881166 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:01.881708 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:01.882777 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:01.883239 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:01.883821 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:02.057635 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:02.066788 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:02.069863 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:02.071320 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e2603dd6-8da7-4857-8623-a610a7e18383 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.206213 Oct 31 15:02:02.072501 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 321/686] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:01 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:02.831317 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-8f4fa765-c643-4813-a03d-1832cd961a9f req-fbbbe489-b116-4552-b652-c4d25c000b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9357fbec-cc10-4069-9fa4-fdeefcbe705b", "name": "network-vif-deleted", "tag": "986667c8-d6cc-428f-9699-9ed7f61777ed"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:02.842492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:02.843173 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:02.848024 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-8f4fa765-c643-4813-a03d-1832cd961a9f req-fbbbe489-b116-4552-b652-c4d25c000b92 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:02.848699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-8f4fa765-c643-4813-a03d-1832cd961a9f req-fbbbe489-b116-4552-b652-c4d25c000b92 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:02.849639 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-8f4fa765-c643-4813-a03d-1832cd961a9f req-fbbbe489-b116-4552-b652-c4d25c000b92 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:02.850627 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:02.851195 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:02.852152 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:02.860605 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:02.861988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:02.863034 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:02.879486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:02:02.880718 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-8f4fa765-c643-4813-a03d-1832cd961a9f req-fbbbe489-b116-4552-b652-c4d25c000b92 service nova] Creating event network-vif-deleted:986667c8-d6cc-428f-9699-9ed7f61777ed for instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b on hv-cinder-86022 Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b HTTP/1.1 Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:02:02.881643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:02:02.883107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '9357fbec-cc10-4069-9fa4-fdeefcbe705b'} Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:02:02.883988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:02:02.885915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:02.888110 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:02:02.889989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-aa406de5-0d8f-4115-ba19-e6475afdacf9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 404 len: 111 microversion: 2.1 time: 0.051644 Oct 31 15:02:02.892415 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 322/687] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:02 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:02:02.893616 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-8f4fa765-c643-4813-a03d-1832cd961a9f req-fbbbe489-b116-4552-b652-c4d25c000b92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066537 Oct 31 15:02:02.898275 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 366/688] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:02.902979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7b1af194-a673-436b-baf6-de6f8627b918 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '.version_select at 0x7f6c70d26820>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:02.929266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7b1af194-a673-436b-baf6-de6f8627b918 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382629410" status: 202 len: 0 microversion: 2.1 time: 0.031022 Oct 31 15:02:02.930188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 323/689] 10.222.0.36 () {58 vars in 1221 bytes} [Mon Oct 31 15:02:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382629410 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:02:03.102239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:03.103499 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:03.120031 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:03.120880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:03.121019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:03.131904 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:03.133164 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:03.133946 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:03.485422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:03.489092 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:03.501875 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:03.503364 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:03.504647 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0866391d-13ec-4d94-873b-d3b22fa7c2eb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.408100 Oct 31 15:02:03.509959 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 367/690] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:03 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:03.948992 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a5b18460-a6a1-4f24-8b33-c2edd3705a3e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: .version_select at 0x7f6c70cc41f0>, body: {"keypair": {"name": "tempest-keypair-16116865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADiWqOpQmeZGjx6E2HQ2mrpuJsyjqTeR0tITyt0IMmh6V1M0iFPUsKuqx18Rf0zvmedcikvtGKGjYoOES4WQOfNv8W4oRWliGCOX8HzBOZU+wcQ0dH9/nbAMrV6KtaJbQ=="}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:03.967094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-a5b18460-a6a1-4f24-8b33-c2edd3705a3e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for project f629aa044ca845069237ecb8d889284e. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:02:03.971972 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-a5b18460-a6a1-4f24-8b33-c2edd3705a3e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for user cdcbcb2ed9e44dbe8444e531fc1eb707 and project f629aa044ca845069237ecb8d889284e. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:02:04.018873 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a5b18460-a6a1-4f24-8b33-c2edd3705a3e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.075244 Oct 31 15:02:04.043989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 324/691] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 15:02:03 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:04.538588 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:04.539194 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:04.564173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:04.564836 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:04.566522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:04.569632 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:04.570431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:04.571045 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:04.960433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:04.972550 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:04.974301 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:04.976174 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2a228fa5-4044-4172-9407-85ed0eaa9be0 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.444045 Oct 31 15:02:04.977231 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 368/692] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:04 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:06.012555 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:06.012555 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:06.019800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:06.034345 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:06.034868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:06.035315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:06.044146 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:06.044957 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:06.046128 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:06.159945 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-529340468", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "344848ef-d9a5-4f9a-8ddf-c96c364ed358"}], "security_groups": [{"name": "tempest-securitygroup--1003288076"}], "key_name": "tempest-keypair-16116865", "user_data": "}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:06.386763 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:06.400290 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:06.407661 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:06.409936 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-23df6998-5ae7-43f3-b615-70faa03174d6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.405685 Oct 31 15:02:06.417231 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 325/693] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:06 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:06.454623 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] validate_networks() for [('344848ef-d9a5-4f9a-8ddf-c96c364ed358', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:02:06.714185 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-07044363-ca4b-4e13-b9aa-38a9074a6e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:06.717532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-07044363-ca4b-4e13-b9aa-38a9074a6e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:06.735748 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-07044363-ca4b-4e13-b9aa-38a9074a6e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:06.740856 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-07044363-ca4b-4e13-b9aa-38a9074a6e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:06.741645 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-07044363-ca4b-4e13-b9aa-38a9074a6e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:06.742629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-07044363-ca4b-4e13-b9aa-38a9074a6e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:06.746204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-07044363-ca4b-4e13-b9aa-38a9074a6e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:06.746941 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-07044363-ca4b-4e13-b9aa-38a9074a6e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:06.812940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-07044363-ca4b-4e13-b9aa-38a9074a6e06 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105521 Oct 31 15:02:06.819825 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 326/694] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:02:06 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:06.834078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f3e5cad2-885f-4bf7-9eb9-f0a289ca667b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:06.839521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f3e5cad2-885f-4bf7-9eb9-f0a289ca667b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:06.850934 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3e5cad2-885f-4bf7-9eb9-f0a289ca667b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:06.852782 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3e5cad2-885f-4bf7-9eb9-f0a289ca667b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:06.853398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3e5cad2-885f-4bf7-9eb9-f0a289ca667b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:06.855666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3e5cad2-885f-4bf7-9eb9-f0a289ca667b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:06.856313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3e5cad2-885f-4bf7-9eb9-f0a289ca667b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:06.856919 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f3e5cad2-885f-4bf7-9eb9-f0a289ca667b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:06.901381 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f3e5cad2-885f-4bf7-9eb9-f0a289ca667b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/0cdf662b-310c-4889-b941-1374f1c8e161" status: 200 len: 194 microversion: 2.1 time: 0.073500 Oct 31 15:02:06.907542 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 327/695] 10.222.0.36 () {58 vars in 1413 bytes} [Mon Oct 31 15:02:06 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/0cdf662b-310c-4889-b941-1374f1c8e161 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:07.254304 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:02:07.254868 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:02:07.255263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:02:07.255697 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:02:07.256137 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:02:07.266672 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:07.267530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:07.268339 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:07.271733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:07.272605 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:07.273321 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:07.304237 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for project f629aa044ca845069237ecb8d889284e. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:02:07.309591 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Getting quotas for user cdcbcb2ed9e44dbe8444e531fc1eb707 and project f629aa044ca845069237ecb8d889284e. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:02:07.324140 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:02:07.326955 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:02:07.361853 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:07.402866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b1efac5b-ed37-4e64-b618-b9f2c271e6a4 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.251052 Oct 31 15:02:07.404618 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 369/696] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:02:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:02:07.426928 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6dd6307e-4145-4cd6-9b68-462e2093d731 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:07.427538 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6dd6307e-4145-4cd6-9b68-462e2093d731 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:07.445746 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:07.446520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:07.455741 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:07.456936 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:07.457442 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:07.459005 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:07.459646 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:07.460225 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:07.550010 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6dd6307e-4145-4cd6-9b68-462e2093d731 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:07.562885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6dd6307e-4145-4cd6-9b68-462e2093d731 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1239 microversion: 2.1 time: 0.139815 Oct 31 15:02:07.564249 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 328/697] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:07 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1239 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:07.723967 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:07.735052 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:07.736570 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:07.737851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-230611a3-9b18-4432-ba85-cf969a4587dc tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.300005 Oct 31 15:02:07.739030 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 370/698] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:07 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:02:08.524504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-af321c71-5c43-4425-8fb4-1018843f1cfc tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661da5ed-9fa2-4add-bc71-73544ac205c5"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:08.528034 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-af321c71-5c43-4425-8fb4-1018843f1cfc tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:08.551893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af321c71-5c43-4425-8fb4-1018843f1cfc tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:08.555313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af321c71-5c43-4425-8fb4-1018843f1cfc tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:08.555814 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af321c71-5c43-4425-8fb4-1018843f1cfc tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:08.565658 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af321c71-5c43-4425-8fb4-1018843f1cfc tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:08.569671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af321c71-5c43-4425-8fb4-1018843f1cfc tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:08.574695 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af321c71-5c43-4425-8fb4-1018843f1cfc tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:08.596848 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:08.600826 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:08.621657 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:08.622508 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:08.637042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:08.639493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:08.640191 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:08.641343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:08.764533 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:08.776404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-37208bd7-a19f-48f1-8ba1-2a925ca2fb95 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1291 microversion: 2.1 time: 0.188327 Oct 31 15:02:08.777632 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 371/699] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:08 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1291 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:08.782976 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:08.783949 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:08.791580 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:08.792435 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:08.793072 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:08.794197 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:08.794961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:08.795395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:08.994542 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:09.007730 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:09.009941 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:09.011665 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-24431088-87f4-4784-b5e7-f2ab763ee993 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.232697 Oct 31 15:02:09.012430 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 372/700] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:08 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:09.243360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-af321c71-5c43-4425-8fb4-1018843f1cfc tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "POST /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724670 Oct 31 15:02:09.245533 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 329/701] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:02:08 2022] POST /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:09.825091 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:09.826457 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:09.848912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:09.849978 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:09.851535 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:09.852978 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:09.854846 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:09.856512 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:09.964297 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:09.976048 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-392ed7cc-b3ae-4e3e-9357-44558d81fb4a tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1297 microversion: 2.1 time: 0.158288 Oct 31 15:02:09.977318 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 373/702] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:09 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1297 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:02:10.040150 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:10.041033 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:10.048942 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:10.049808 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:10.050485 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:10.051706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:10.052383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:10.053031 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:10.279712 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:10.305749 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:10.308373 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:10.309626 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4e64b8ad-0aca-4f47-90c0-f56b0dda24b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.275829 Oct 31 15:02:10.335722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 330/703] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:10 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:11.007723 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:11.010997 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:11.021721 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:11.023480 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:11.023945 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:11.024655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:11.025176 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:11.025820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:11.058572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-fcfd2c79-fa84-4d17-ad79-796142f3b062 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70cc4d30>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:11.177591 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-fcfd2c79-fa84-4d17-ad79-796142f3b062 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/53e5f584-762a-44d0-80fd-ee7fa4fbf769" status: 200 len: 351 microversion: 2.1 time: 0.124658 Oct 31 15:02:11.178361 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 331/704] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 15:02:11 2022] GET /compute/v2.1/os-volumes/53e5f584-762a-44d0-80fd-ee7fa4fbf769 => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:02:11.241867 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:11.253831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e052338d-33f4-470f-9cb9-34a20cbd9d94 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1365 microversion: 2.1 time: 0.252181 Oct 31 15:02:11.267647 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 374/705] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:11 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:11.348096 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:11.349148 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:11.356935 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:11.357802 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:11.358762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:11.360737 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:11.361386 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:11.362122 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:11.702115 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-9b1fb1ff-e3e3-494d-9cad-2500741fd97e req-560a294f-707c-4d88-bda8-c32bb4c11e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbc41e7-a0c8-411f-a862-74bba534647d", "tag": "0e848f26-da30-41e1-b524-98ff8a6a72e8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:11.712743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9b1fb1ff-e3e3-494d-9cad-2500741fd97e req-560a294f-707c-4d88-bda8-c32bb4c11e6b service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:11.713741 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9b1fb1ff-e3e3-494d-9cad-2500741fd97e req-560a294f-707c-4d88-bda8-c32bb4c11e6b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:11.714393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9b1fb1ff-e3e3-494d-9cad-2500741fd97e req-560a294f-707c-4d88-bda8-c32bb4c11e6b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:11.727295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-9b1fb1ff-e3e3-494d-9cad-2500741fd97e req-560a294f-707c-4d88-bda8-c32bb4c11e6b service nova] Creating event network-changed:0e848f26-da30-41e1-b524-98ff8a6a72e8 for instance adbc41e7-a0c8-411f-a862-74bba534647d on hv-cinder-86022 Oct 31 15:02:11.737129 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-9b1fb1ff-e3e3-494d-9cad-2500741fd97e req-560a294f-707c-4d88-bda8-c32bb4c11e6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301872 Oct 31 15:02:11.739803 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 375/706] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:02:11.836384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:11.847858 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:11.849803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:11.851317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d54ef68d-e43d-4afc-bb6c-e84034c21b91 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.508906 Oct 31 15:02:11.852104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 332/707] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:11 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:12.282065 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:12.282684 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:12.289951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:12.290760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:12.291481 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:12.292453 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:12.293126 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:12.293554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:12.440627 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:12.449771 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-40a55c4b-d23b-48b2-ae99-98275eadb879 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1365 microversion: 2.1 time: 0.172027 Oct 31 15:02:12.450345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 376/708] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:12 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:12.839468 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5ad75d09-866f-4125-8abd-c6c94bbc078d tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70cac790>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:12.877410 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:12.878030 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:12.885823 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:12.886819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:12.887432 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:12.888347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:12.888968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:12.889554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:12.902395 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5ad75d09-866f-4125-8abd-c6c94bbc078d tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/705bdc3b-08ff-4079-b754-f4c09fc8b41e" status: 200 len: 350 microversion: 2.1 time: 0.067152 Oct 31 15:02:12.904777 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 333/709] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 15:02:12 2022] GET /compute/v2.1/os-volumes/705bdc3b-08ff-4079-b754-f4c09fc8b41e => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:13.063296 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:13.074347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:13.076314 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:13.078466 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d756605e-063a-4d58-9b05-f5d7aee32a0c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.205012 Oct 31 15:02:13.079523 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 377/710] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:12 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:02:13.475603 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:13.476713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:13.483848 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:13.484401 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:13.492611 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:13.493370 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:13.493919 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:13.494559 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:13.682994 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:13.695870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-411979ea-b5c2-4838-b940-c09eebcc9f47 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1365 microversion: 2.1 time: 0.225835 Oct 31 15:02:13.701354 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 334/711] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:13 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:14.107408 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:14.108969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:14.117623 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:14.118425 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:14.120386 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:14.121382 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:14.122078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:14.122732 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:14.288013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:14.299612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:14.301283 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:14.302573 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-631e7657-9f83-4ea5-bd69-5e43bb7d068d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.201304 Oct 31 15:02:14.303514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 378/712] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:14 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:14.415016 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-87c1f937-bb28-4600-b790-846b9f106e97 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70d60f70>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:14.470680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-87c1f937-bb28-4600-b790-846b9f106e97 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/4ebcd64f-8d04-4da2-af80-5d48b967c3a7" status: 200 len: 351 microversion: 2.1 time: 0.059452 Oct 31 15:02:14.471282 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 335/713] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 15:02:14 2022] GET /compute/v2.1/os-volumes/4ebcd64f-8d04-4da2-af80-5d48b967c3a7 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:14.485071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-616c2d39-e845-448d-b603-1363507692df tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70f699d0>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:14.574224 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-616c2d39-e845-448d-b603-1363507692df tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093002 Oct 31 15:02:14.574792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 379/714] 10.222.0.36 () {58 vars in 1134 bytes} [Mon Oct 31 15:02:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:14.607855 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ac4e3f47-1405-4833-8dc7-3924f92f69d0 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70cac9d0>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:14.710747 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ac4e3f47-1405-4833-8dc7-3924f92f69d0 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.107029 Oct 31 15:02:14.712260 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 336/715] 10.222.0.36 () {58 vars in 1149 bytes} [Mon Oct 31 15:02:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:14.727514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:14.728675 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-71a4fe20-c425-4551-8fde-62b024f24733 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70cd6430>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:14.728966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:14.736139 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:14.736920 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:14.737542 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:14.738677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:14.739747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:14.740712 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:14.861873 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-71a4fe20-c425-4551-8fde-62b024f24733 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.139122 Oct 31 15:02:14.862832 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 337/716] 10.222.0.36 () {58 vars in 1134 bytes} [Mon Oct 31 15:02:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:14.878232 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-10fecb96-468c-4112-a715-14245dbee1c6 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70dc7c10>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:14.914687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:14.922931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9fbb9c32-68fc-433c-84e2-cb4a102d8eb7 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1365 microversion: 2.1 time: 0.200217 Oct 31 15:02:14.936902 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 380/717] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:14 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:14.972897 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-10fecb96-468c-4112-a715-14245dbee1c6 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.100511 Oct 31 15:02:14.973824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 338/718] 10.222.0.36 () {58 vars in 1167 bytes} [Mon Oct 31 15:02:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:02:14.990262 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4f947422-863f-45a8-8ccd-8de2be7853b1 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70e2ad30>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:15.089770 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4f947422-863f-45a8-8ccd-8de2be7853b1 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.104071 Oct 31 15:02:15.090624 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 381/719] 10.222.0.36 () {58 vars in 1170 bytes} [Mon Oct 31 15:02:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:15.105028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9a858ef2-488a-4efc-837f-ccb0e9f27c97 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70e8bca0>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:15.193462 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9a858ef2-488a-4efc-837f-ccb0e9f27c97 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092282 Oct 31 15:02:15.194136 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 339/720] 10.222.0.36 () {58 vars in 1155 bytes} [Mon Oct 31 15:02:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:02:15.208404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-98f09ef1-1c24-4a8b-9a7e-454e4f1451be tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c710a7670>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:15.301793 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-98f09ef1-1c24-4a8b-9a7e-454e4f1451be tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096977 Oct 31 15:02:15.302637 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 382/721] 10.222.0.36 () {58 vars in 1188 bytes} [Mon Oct 31 15:02:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:15.317486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6b8f4c35-9f05-41e3-9503-d4430cd996b2 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] Calling method '.version_select at 0x7f6c70ce9940>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:15.331908 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:15.332709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:15.344538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:15.344538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:15.344538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:15.344538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:15.344904 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:15.344904 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:15.426673 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6b8f4c35-9f05-41e3-9503-d4430cd996b2 tempest-VolumesTestJSON-528403993 tempest-VolumesTestJSON-528403993-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.113577 Oct 31 15:02:15.427502 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 340/722] 10.222.0.36 () {58 vars in 1155 bytes} [Mon Oct 31 15:02:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:15.503539 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:15.516763 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:15.517362 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:15.518541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-df11984c-3975-4723-a890-e47d33e98bdb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1740 microversion: 2.20 time: 0.190655 Oct 31 15:02:15.519123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 383/723] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:15 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:02:15.766869 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-0c109f7e-f2fd-49e9-aec8-bdb1d281742f req-cd9a401b-5772-4979-8174-f236dc3c02d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbc41e7-a0c8-411f-a862-74bba534647d", "name": "network-vif-plugged", "status": "completed", "tag": "0e848f26-da30-41e1-b524-98ff8a6a72e8"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:15.777722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-0c109f7e-f2fd-49e9-aec8-bdb1d281742f req-cd9a401b-5772-4979-8174-f236dc3c02d2 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:15.778288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-0c109f7e-f2fd-49e9-aec8-bdb1d281742f req-cd9a401b-5772-4979-8174-f236dc3c02d2 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:15.778822 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-0c109f7e-f2fd-49e9-aec8-bdb1d281742f req-cd9a401b-5772-4979-8174-f236dc3c02d2 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:15.792762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-0c109f7e-f2fd-49e9-aec8-bdb1d281742f req-cd9a401b-5772-4979-8174-f236dc3c02d2 service nova] Creating event network-vif-plugged:0e848f26-da30-41e1-b524-98ff8a6a72e8 for instance adbc41e7-a0c8-411f-a862-74bba534647d on hv-cinder-86022 Oct 31 15:02:15.797582 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-0c109f7e-f2fd-49e9-aec8-bdb1d281742f req-cd9a401b-5772-4979-8174-f236dc3c02d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034475 Oct 31 15:02:15.798170 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 341/724] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:15.954339 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:15.954954 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:15.960917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:15.961397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:15.961849 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:15.962571 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:15.963022 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:15.963443 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:16.110776 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:16.120629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d9417d47-ca2b-410f-af6d-ef24cad982ba tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1365 microversion: 2.1 time: 0.170019 Oct 31 15:02:16.121211 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 384/725] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:15 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:16.547033 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:16.547745 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:16.553848 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:16.554313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:16.554739 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:16.555409 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:16.555940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:16.556558 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:16.690860 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:16.702496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:16.703988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:16.705310 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e9cbd844-48fa-4471-8471-bbfd156be13a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1722 microversion: 2.20 time: 0.163018 Oct 31 15:02:16.705863 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 342/726] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:16 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:17.019642 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6126a2ab-04b4-4cdf-aa96-703777ddcb41 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:17.021885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6126a2ab-04b4-4cdf-aa96-703777ddcb41 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:17.028677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6126a2ab-04b4-4cdf-aa96-703777ddcb41 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.029153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6126a2ab-04b4-4cdf-aa96-703777ddcb41 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.029588 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6126a2ab-04b4-4cdf-aa96-703777ddcb41 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.030273 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6126a2ab-04b4-4cdf-aa96-703777ddcb41 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.030724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6126a2ab-04b4-4cdf-aa96-703777ddcb41 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.031149 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6126a2ab-04b4-4cdf-aa96-703777ddcb41 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.061554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6126a2ab-04b4-4cdf-aa96-703777ddcb41 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045838 Oct 31 15:02:17.062101 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 385/727] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:02:17 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:17.143350 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:17.143994 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:17.150101 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.150568 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.150998 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.151709 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.152156 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.152589 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.215167 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f709413d-7257-40a7-be6b-19fc6dfcded4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:17.215689 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f709413d-7257-40a7-be6b-19fc6dfcded4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:17.221774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f709413d-7257-40a7-be6b-19fc6dfcded4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.222263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f709413d-7257-40a7-be6b-19fc6dfcded4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.222698 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f709413d-7257-40a7-be6b-19fc6dfcded4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.223388 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f709413d-7257-40a7-be6b-19fc6dfcded4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.223864 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f709413d-7257-40a7-be6b-19fc6dfcded4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.224288 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f709413d-7257-40a7-be6b-19fc6dfcded4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.255004 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f709413d-7257-40a7-be6b-19fc6dfcded4 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/0cdf662b-310c-4889-b941-1374f1c8e161" status: 200 len: 194 microversion: 2.1 time: 0.043848 Oct 31 15:02:17.255618 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 386/728] 10.222.0.36 () {58 vars in 1413 bytes} [Mon Oct 31 15:02:17 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/0cdf662b-310c-4889-b941-1374f1c8e161 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:17.266114 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:17.266603 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:17.272416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.272896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.273328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.274016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.274466 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.275185 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.289524 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:17.319744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=6 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:17.351536 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:17.357740 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lazy-loading 'services' on Instance uuid 37732b02-4aae-470b-860b-9fce11dbc27d {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:02:17.360467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-11468ed4-e8c9-4f04-a2c7-7c9829477354 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1365 microversion: 2.1 time: 0.220794 Oct 31 15:02:17.361398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 343/729] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:17 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:17.430243 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-58058777-314f-4340-ae1c-4529ce4a4f77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/0cdf662b-310c-4889-b941-1374f1c8e161" status: 202 len: 0 microversion: 2.1 time: 0.167773 Oct 31 15:02:17.431003 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 387/730] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:02:17 2022] DELETE /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/0cdf662b-310c-4889-b941-1374f1c8e161 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:02:17.732616 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:17.733255 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:17.738769 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=6 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:17.743358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.743889 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.744353 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.745047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:17.745492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:17.745909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:17.950145 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:17.958708 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:17.960246 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:17.961459 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4c8896dd-69f8-4d5c-a2f8-61500bf4a9e3 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1722 microversion: 2.20 time: 0.233549 Oct 31 15:02:17.963254 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 344/731] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:17 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:18.384851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:18.385471 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:18.391668 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:18.392149 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:18.392583 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:18.393268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:18.393720 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:18.394145 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:18.398199 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:18.530055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:18.547039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3a698234-55be-47ca-8214-d8e2a47c9d32 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1554 microversion: 2.1 time: 0.160570 Oct 31 15:02:18.547039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 388/732] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:18 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:18.563390 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bc228241-ee7b-4ce9-afd2-16214c1f66e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:18.563925 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-bc228241-ee7b-4ce9-afd2-16214c1f66e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:18.569845 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc228241-ee7b-4ce9-afd2-16214c1f66e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:18.570320 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc228241-ee7b-4ce9-afd2-16214c1f66e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:18.570749 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc228241-ee7b-4ce9-afd2-16214c1f66e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:18.571490 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc228241-ee7b-4ce9-afd2-16214c1f66e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:18.571966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc228241-ee7b-4ce9-afd2-16214c1f66e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:18.572390 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc228241-ee7b-4ce9-afd2-16214c1f66e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:18.576321 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:18.651756 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-bc228241-ee7b-4ce9-afd2-16214c1f66e6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092160 Oct 31 15:02:18.652404 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 345/733] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 31 15:02:18 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:18.988420 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:18.989336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:18.995490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:18.996415 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:18.997027 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:18.997882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:18.998491 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:18.999084 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:19.140850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:19.150699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:19.152193 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:19.153373 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2479d632-1bd9-4b1e-8e5f-b0ed4b6620bb tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1722 microversion: 2.20 time: 0.168764 Oct 31 15:02:19.153919 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 389/734] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:18 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:19.914127 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-d7eedd23-d573-4fb4-81ea-16a63279a2f1 req-5af700be-b986-4c83-aeb2-76170d7d819f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78da101-dab9-43eb-b75d-14baee21f5c0", "name": "network-vif-unplugged", "status": "completed", "tag": "fad9b881-1f6a-40eb-9847-b09fa756357c"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:19.926390 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-d7eedd23-d573-4fb4-81ea-16a63279a2f1 req-5af700be-b986-4c83-aeb2-76170d7d819f service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:19.926899 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-d7eedd23-d573-4fb4-81ea-16a63279a2f1 req-5af700be-b986-4c83-aeb2-76170d7d819f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:19.928015 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-d7eedd23-d573-4fb4-81ea-16a63279a2f1 req-5af700be-b986-4c83-aeb2-76170d7d819f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:19.955951 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-d7eedd23-d573-4fb4-81ea-16a63279a2f1 req-5af700be-b986-4c83-aeb2-76170d7d819f service nova] Creating event network-vif-unplugged:fad9b881-1f6a-40eb-9847-b09fa756357c for instance e78da101-dab9-43eb-b75d-14baee21f5c0 on hv-cinder-86022 Oct 31 15:02:19.969555 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-d7eedd23-d573-4fb4-81ea-16a63279a2f1 req-5af700be-b986-4c83-aeb2-76170d7d819f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.226647 Oct 31 15:02:19.973532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 346/735] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:19.997858 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-dc443197-c51e-4dfb-9d84-d4490893ef4c req-bb5edb02-0507-4a2b-a4ec-882143e8faf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbc41e7-a0c8-411f-a862-74bba534647d", "tag": "0e848f26-da30-41e1-b524-98ff8a6a72e8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:20.011913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-dc443197-c51e-4dfb-9d84-d4490893ef4c req-bb5edb02-0507-4a2b-a4ec-882143e8faf6 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:20.012759 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-dc443197-c51e-4dfb-9d84-d4490893ef4c req-bb5edb02-0507-4a2b-a4ec-882143e8faf6 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:20.014397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-dc443197-c51e-4dfb-9d84-d4490893ef4c req-bb5edb02-0507-4a2b-a4ec-882143e8faf6 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:20.030281 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-dc443197-c51e-4dfb-9d84-d4490893ef4c req-bb5edb02-0507-4a2b-a4ec-882143e8faf6 service nova] Creating event network-changed:0e848f26-da30-41e1-b524-98ff8a6a72e8 for instance adbc41e7-a0c8-411f-a862-74bba534647d on hv-cinder-86022 Oct 31 15:02:20.036268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-dc443197-c51e-4dfb-9d84-d4490893ef4c req-bb5edb02-0507-4a2b-a4ec-882143e8faf6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044175 Oct 31 15:02:20.038184 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 390/736] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:20.179563 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:20.180254 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:20.191315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:20.193629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:20.194163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:20.194876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:20.195940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:20.197061 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:20.411720 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:20.421715 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:20.423400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:20.424678 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2bc40504-90e2-46a4-85cc-3dafac0e9e14 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1725 microversion: 2.20 time: 0.249847 Oct 31 15:02:20.425310 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 347/737] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:20 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:02:20.450776 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0d2d287c-b95d-40bb-9dcd-2f96ed0eaaf5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce1088e3-f6d2-4864-87b2-a88db42924b5"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:20.453228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0d2d287c-b95d-40bb-9dcd-2f96ed0eaaf5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:20.459199 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d2d287c-b95d-40bb-9dcd-2f96ed0eaaf5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:20.459716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d2d287c-b95d-40bb-9dcd-2f96ed0eaaf5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:20.460148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d2d287c-b95d-40bb-9dcd-2f96ed0eaaf5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:20.460837 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d2d287c-b95d-40bb-9dcd-2f96ed0eaaf5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:20.461287 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d2d287c-b95d-40bb-9dcd-2f96ed0eaaf5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:20.461697 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0d2d287c-b95d-40bb-9dcd-2f96ed0eaaf5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:20.685092 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-297706ab-4ace-49ec-a89f-656b5499025a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:20.685818 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-297706ab-4ace-49ec-a89f-656b5499025a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:20.692836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-297706ab-4ace-49ec-a89f-656b5499025a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:20.693679 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-297706ab-4ace-49ec-a89f-656b5499025a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:20.694279 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-297706ab-4ace-49ec-a89f-656b5499025a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:20.695144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-297706ab-4ace-49ec-a89f-656b5499025a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:20.695851 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-297706ab-4ace-49ec-a89f-656b5499025a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:20.696475 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-297706ab-4ace-49ec-a89f-656b5499025a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:20.740160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-297706ab-4ace-49ec-a89f-656b5499025a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/661da5ed-9fa2-4add-bc71-73544ac205c5" status: 200 len: 194 microversion: 2.1 time: 0.059935 Oct 31 15:02:20.741431 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 348/738] 10.222.0.36 () {58 vars in 1413 bytes} [Mon Oct 31 15:02:20 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/661da5ed-9fa2-4add-bc71-73544ac205c5 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:20.753392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:20.754489 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:20.764196 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:20.765021 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:20.765879 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:20.766771 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:20.767728 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:20.768318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:20.868984 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0d2d287c-b95d-40bb-9dcd-2f96ed0eaaf5 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.422405 Oct 31 15:02:20.870322 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 391/739] 10.222.0.36 () {62 vars in 1364 bytes} [Mon Oct 31 15:02:20 2022] POST /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/os-volume_attachments => generated 188 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:02:20.883718 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lazy-loading 'services' on Instance uuid 37732b02-4aae-470b-860b-9fce11dbc27d {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:02:20.989435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8c263a40-a7cb-4234-9166-f773d3f2ac77 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/661da5ed-9fa2-4add-bc71-73544ac205c5" status: 202 len: 0 microversion: 2.1 time: 0.241122 Oct 31 15:02:20.990987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 349/740] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:02:20 2022] DELETE /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments/661da5ed-9fa2-4add-bc71-73544ac205c5 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:02:21.047540 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8d75323c-a47f-4cfc-a4c9-3f2c47cae357 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:21.048146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8d75323c-a47f-4cfc-a4c9-3f2c47cae357 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:21.062242 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8d75323c-a47f-4cfc-a4c9-3f2c47cae357 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:21.062743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8d75323c-a47f-4cfc-a4c9-3f2c47cae357 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:21.063181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8d75323c-a47f-4cfc-a4c9-3f2c47cae357 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:21.063928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8d75323c-a47f-4cfc-a4c9-3f2c47cae357 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:21.064531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8d75323c-a47f-4cfc-a4c9-3f2c47cae357 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:21.065204 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8d75323c-a47f-4cfc-a4c9-3f2c47cae357 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:21.342787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8d75323c-a47f-4cfc-a4c9-3f2c47cae357 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/os-volume_attachments/ce1088e3-f6d2-4864-87b2-a88db42924b5" status: 202 len: 0 microversion: 2.20 time: 0.302753 Oct 31 15:02:21.361102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 392/741] 10.222.0.36 () {60 vars in 1457 bytes} [Mon Oct 31 15:02:21 2022] DELETE /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/os-volume_attachments/ce1088e3-f6d2-4864-87b2-a88db42924b5 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:02:21.437801 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:21.438486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:21.444908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:21.445396 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:21.445832 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:21.446564 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:21.447198 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:21.447908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:21.489426 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134338) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 15:02:21.560067 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-71c15dfa-eaa8-4963-a2f5-0200b663ac6b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "POST /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/action" status: 202 len: 0 microversion: 2.20 time: 0.126566 Oct 31 15:02:21.560700 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 350/742] 10.222.0.36 () {62 vars in 1319 bytes} [Mon Oct 31 15:02:21 2022] POST /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:02:21.568774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:21.569545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:21.576654 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:21.577380 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:21.577817 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:21.578595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:21.579259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:21.579724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:21.778693 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:21.794193 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:21.797982 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:21.799196 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9f020b58-dd20-48b9-b61a-9bdf56a2093c tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1673 microversion: 2.20 time: 0.234335 Oct 31 15:02:21.803106 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 393/743] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:21 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:02:22.207104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0bfca352-b9ef-4c49-b067-53883bc3281a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:22.209163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0bfca352-b9ef-4c49-b067-53883bc3281a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:22.215633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0bfca352-b9ef-4c49-b067-53883bc3281a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.216119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0bfca352-b9ef-4c49-b067-53883bc3281a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.216543 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0bfca352-b9ef-4c49-b067-53883bc3281a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.217410 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0bfca352-b9ef-4c49-b067-53883bc3281a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.217861 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0bfca352-b9ef-4c49-b067-53883bc3281a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.218267 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0bfca352-b9ef-4c49-b067-53883bc3281a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.252357 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0bfca352-b9ef-4c49-b067-53883bc3281a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049720 Oct 31 15:02:22.253344 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 351/744] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:02:22 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:02:22.387716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-80282ea5-c94a-4cb7-835c-336c78f3ff6e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:22.390136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-80282ea5-c94a-4cb7-835c-336c78f3ff6e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:22.396780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80282ea5-c94a-4cb7-835c-336c78f3ff6e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.397381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80282ea5-c94a-4cb7-835c-336c78f3ff6e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.397919 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80282ea5-c94a-4cb7-835c-336c78f3ff6e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.398709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80282ea5-c94a-4cb7-835c-336c78f3ff6e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.399373 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80282ea5-c94a-4cb7-835c-336c78f3ff6e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.400685 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-80282ea5-c94a-4cb7-835c-336c78f3ff6e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.433624 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-80282ea5-c94a-4cb7-835c-336c78f3ff6e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050370 Oct 31 15:02:22.434199 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 394/745] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:02:22 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:02:22.503589 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:22.504266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:22.511619 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.512102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.512710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.513398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.514002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.514471 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.555317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:02:22.679706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7109d749-0174-478c-adf0-eefb6e639690 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 204 len: 0 microversion: 2.1 time: 0.179746 Oct 31 15:02:22.685278 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 352/746] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:02:22 2022] DELETE /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:02:22.690260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:22.690882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:22.697939 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.698425 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.699033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.699941 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.700637 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.701265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.830438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:22.831195 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:22.839007 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.839847 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.840429 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.841280 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:22.841937 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:22.842504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:22.940948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:22.951088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5341d117-f98e-4e92-ae22-bb1600bc3911 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1673 microversion: 2.1 time: 0.265110 Oct 31 15:02:22.952237 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 395/747] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:22 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1673 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:02:23.001593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:23.017306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:23.018742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:23.019952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d01617b9-1a82-4c69-9897-5c659807d06b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1673 microversion: 2.20 time: 0.194213 Oct 31 15:02:23.031253 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 353/748] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:22 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:23.975328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:23.975876 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:23.982406 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:23.982890 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:23.983321 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:23.984035 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:23.984507 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:23.984922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.056850 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:24.058327 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:24.065098 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:24.065623 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:24.066241 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.066950 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:24.067403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:24.068235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:24.148088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:24.156408 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e401e9e7-6055-46c9-a7ed-b21f5c70b13b tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1673 microversion: 2.1 time: 0.184939 Oct 31 15:02:24.157068 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 396/749] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:23 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:24.280516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:24.289261 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:24.290785 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:24.292023 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ba51fe9d-f293-4b38-bead-eba73db589f1 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1673 microversion: 2.20 time: 0.239733 Oct 31 15:02:24.292579 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 354/750] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:24 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:02:25.180069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:25.181745 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:25.189587 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:25.190103 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:25.190510 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:25.193206 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:25.193842 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:25.194773 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:25.267478 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:25.277969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-364084bf-c6da-46f1-9ec3-0640f2f0610e tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1606 microversion: 2.1 time: 0.101559 Oct 31 15:02:25.278462 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 397/751] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:25 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1606 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:25.319398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:25.320236 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:25.330651 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:25.331600 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:25.332198 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:25.333119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:25.333759 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:25.334185 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:25.834672 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:25.843567 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:25.845021 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:25.846302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-bb7e3717-1c9a-4a20-aa55-c3ac431fa877 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.530948 Oct 31 15:02:25.847015 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 355/752] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:25 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:02:25.979410 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-81cf88ec-2922-4ee8-bd3b-a14a2fb628f8 req-bf861be9-a038-48b5-9abb-0aeff08ae861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37732b02-4aae-470b-860b-9fce11dbc27d", "name": "network-vif-deleted", "tag": "873de307-4df8-44d0-9916-a5145ef5bdb4"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:25.994245 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-81cf88ec-2922-4ee8-bd3b-a14a2fb628f8 req-bf861be9-a038-48b5-9abb-0aeff08ae861 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:25.995802 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-81cf88ec-2922-4ee8-bd3b-a14a2fb628f8 req-bf861be9-a038-48b5-9abb-0aeff08ae861 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:26.002362 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-81cf88ec-2922-4ee8-bd3b-a14a2fb628f8 req-bf861be9-a038-48b5-9abb-0aeff08ae861 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:26.038913 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-81cf88ec-2922-4ee8-bd3b-a14a2fb628f8 req-bf861be9-a038-48b5-9abb-0aeff08ae861 service nova] Creating event network-vif-deleted:873de307-4df8-44d0-9916-a5145ef5bdb4 for instance 37732b02-4aae-470b-860b-9fce11dbc27d on hv-cinder-86022 Oct 31 15:02:26.054183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-81cf88ec-2922-4ee8-bd3b-a14a2fb628f8 req-bf861be9-a038-48b5-9abb-0aeff08ae861 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077695 Oct 31 15:02:26.055303 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 398/753] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:26.301844 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:26.302450 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:26.314265 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:26.314855 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:26.315299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:26.318035 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:26.318581 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:26.319316 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:26.356915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:26.358215 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:26.358832 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:26.359428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lazy-loading 'fault' on Instance uuid 37732b02-4aae-470b-860b-9fce11dbc27d {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:02:26.409066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d1901be8064ff5bf79f0268d589e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdab2d4f39c64f239ded71cc9773c8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:26.418092 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-48fbbbc8-4c08-4156-a649-3044ed952fea tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 200 len: 1328 microversion: 2.1 time: 0.119904 Oct 31 15:02:26.428843 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 356/754] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:26 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:02:26.877055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:26.877800 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:26.888203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:26.888912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:26.889631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:26.890511 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:26.890964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:26.891381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:27.176606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:27.189393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:27.191508 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:27.194512 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2e526bed-29e0-4daf-8f62-1d8ff0943a29 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.324406 Oct 31 15:02:27.195393 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 399/755] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:26 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:27.444075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:27.444813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:27.468251 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:27.469235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:27.469983 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:27.470925 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:27.484601 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:27.485648 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:27.538633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] HTTP exception thrown: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Request method failure captured: Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d HTTP/1.1 Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-IqM_zV1tPASH1OufiXt4PFjQsznL4Nw-CU1lkjZtpDjcyQzzG5in5uB3SxtypXkJT1OupZCWXK6aiyN0nuWaaAS_3kQ6N1j0D85kV36noiZe9BHEQBRDXs0c2bK1JvpUSpnfAMBPLRpT4md3kfTC94HyNx5HYUTUJJm6eMme4zwz4 Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:02:27.540710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fdab2d4f39c64f239ded71cc9773c8bb"}]}] Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: 75d1901be8064ff5bf79f0268d589e10 Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:27.542022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '37732b02-4aae-470b-860b-9fce11dbc27d'} Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:02:27.542742 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:27.544633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:02:27.548287 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Returning 404 to user: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:02:27.550241 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ef2b9075-f326-4570-b3ab-b4b9c33ccbc9 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 404 len: 111 microversion: 2.1 time: 0.111990 Oct 31 15:02:27.552158 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 357/756] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:27 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:02:27.561433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0bba04e0-d50f-46c7-a44a-6a653b3ecef5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '.version_select at 0x7f6c7473f820>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:27.597008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0bba04e0-d50f-46c7-a44a-6a653b3ecef5 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963771868" status: 202 len: 0 microversion: 2.1 time: 0.039702 Oct 31 15:02:27.598120 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 400/757] 10.222.0.36 () {58 vars in 1221 bytes} [Mon Oct 31 15:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963771868 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:02:28.258804 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:28.260681 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:28.269819 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:28.270436 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:28.271097 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:28.271939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:28.272589 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:28.273104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:28.537234 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:28.549091 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:28.551164 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:28.552984 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-576aa306-2eb9-4dd0-a99b-218f7da85474 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.315925 Oct 31 15:02:28.553623 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 358/758] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:28 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:29.579069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:29.579792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:29.586004 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:29.587207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:29.587902 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:29.588843 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:29.589563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:29.590243 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:29.741316 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:29.751506 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:29.753039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:29.755175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ce597804-ace5-48a8-a163-657744af9033 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.180565 Oct 31 15:02:29.763909 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 401/759] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:29 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:30.790464 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:30.792719 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:30.804363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:30.804779 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:30.807154 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:30.807957 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:30.808412 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:30.816651 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:30.896868 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:30.897870 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:30.912010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:30.912498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:30.912931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:30.913630 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:30.914097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:30.915540 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:30.918429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:30.940561 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] HTTP exception thrown: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Request method failure captured: Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: DELETE /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d HTTP/1.1 Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-IqM_zV1tPASH1OufiXt4PFjQsznL4Nw-CU1lkjZtpDjcyQzzG5in5uB3SxtypXkJT1OupZCWXK6aiyN0nuWaaAS_3kQ6N1j0D85kV36noiZe9BHEQBRDXs0c2bK1JvpUSpnfAMBPLRpT4md3kfTC94HyNx5HYUTUJJm6eMme4zwz4 Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:02:30.942221 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fdab2d4f39c64f239ded71cc9773c8bb"}]}] Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 75d1901be8064ff5bf79f0268d589e10 Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.943809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '37732b02-4aae-470b-860b-9fce11dbc27d'} Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:02:30.944700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.947340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.950661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Returning 404 to user: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:02:30.950661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b2c9820a-97f2-4cef-af30-5b99e770b42a tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 404 len: 111 microversion: 2.1 time: 0.050523 Oct 31 15:02:30.950661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 402/760] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:02:30 2022] DELETE /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:02:30.954083 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:30.954889 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 37732b02-4aae-470b-860b-9fce11dbc27d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:30.962858 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:30.963574 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:30.964195 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:30.965055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:30.965791 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:30.966370 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:30.968881 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:30.972377 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:30.979089 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:30.980632 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:30.981803 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0ff06cbb-28db-42b0-ab6c-1e149796a318 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.200031 Oct 31 15:02:30.982354 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 359/761] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:30 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:30.983299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] HTTP exception thrown: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Request method failure captured: Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d HTTP/1.1 Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-IqM_zV1tPASH1OufiXt4PFjQsznL4Nw-CU1lkjZtpDjcyQzzG5in5uB3SxtypXkJT1OupZCWXK6aiyN0nuWaaAS_3kQ6N1j0D85kV36noiZe9BHEQBRDXs0c2bK1JvpUSpnfAMBPLRpT4md3kfTC94HyNx5HYUTUJJm6eMme4zwz4 Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:02:30.984862 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fdab2d4f39c64f239ded71cc9773c8bb"}]}] Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 75d1901be8064ff5bf79f0268d589e10 Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.986376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '37732b02-4aae-470b-860b-9fce11dbc27d'} Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:02:30.987200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. Oct 31 15:02:30.988636 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:30.989880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Returning 404 to user: Instance 37732b02-4aae-470b-860b-9fce11dbc27d could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:02:30.989880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cbf20413-8e9e-4b0a-8c29-01a122fcfafa tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d" status: 404 len: 111 microversion: 2.1 time: 0.036241 Oct 31 15:02:30.989880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 403/762] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:30 2022] GET /compute/v2.1/servers/37732b02-4aae-470b-860b-9fce11dbc27d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:02:32.013388 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:32.014668 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:32.024364 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:32.024364 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:32.024364 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:32.024768 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:32.025617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:32.026183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:32.146265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:32.146984 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:32.154297 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:32.154888 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:32.155333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:32.156204 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:32.156655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:32.157084 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:32.171129 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] HTTP exception thrown: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Request method failure captured: Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: DELETE /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 HTTP/1.1 Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-IqM_zV1tPASH1OufiXt4PFjQsznL4Nw-CU1lkjZtpDjcyQzzG5in5uB3SxtypXkJT1OupZCWXK6aiyN0nuWaaAS_3kQ6N1j0D85kV36noiZe9BHEQBRDXs0c2bK1JvpUSpnfAMBPLRpT4md3kfTC94HyNx5HYUTUJJm6eMme4zwz4 Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:02:32.172724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fdab2d4f39c64f239ded71cc9773c8bb"}]}] Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 75d1901be8064ff5bf79f0268d589e10 Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.174259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '820c59dc-ee1a-4470-b9d6-14060ebd8337'} Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:02:32.175165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.176648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.178022 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Returning 404 to user: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:02:32.178022 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ad0c3115-4f28-4a3e-9725-7df4f1ecca01 tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "DELETE /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 404 len: 111 microversion: 2.1 time: 0.031803 Oct 31 15:02:32.178022 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 404/763] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:02:32 2022] DELETE /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:02:32.182258 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:32.182861 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] [instance: 820c59dc-ee1a-4470-b9d6-14060ebd8337] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:32.188663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:32.189148 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:32.189581 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:32.190270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:32.190718 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:32.191310 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:32.199880 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:32.206151 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] HTTP exception thrown: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Request method failure captured: Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 HTTP/1.1 Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-IqM_zV1tPASH1OufiXt4PFjQsznL4Nw-CU1lkjZtpDjcyQzzG5in5uB3SxtypXkJT1OupZCWXK6aiyN0nuWaaAS_3kQ6N1j0D85kV36noiZe9BHEQBRDXs0c2bK1JvpUSpnfAMBPLRpT4md3kfTC94HyNx5HYUTUJJm6eMme4zwz4 Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:02:32.207711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fdab2d4f39c64f239ded71cc9773c8bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fdab2d4f39c64f239ded71cc9773c8bb"}]}] Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: fdab2d4f39c64f239ded71cc9773c8bb Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934365025 Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 75d1901be8064ff5bf79f0268d589e10 Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeTestJSON-1934365025-project Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.209244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '820c59dc-ee1a-4470-b9d6-14060ebd8337'} Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:02:32.210118 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. Oct 31 15:02:32.212155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:02:32.213424 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:32.213533 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] Returning 404 to user: Instance 820c59dc-ee1a-4470-b9d6-14060ebd8337 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:02:32.213533 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-20ca20cc-bf79-461f-b48a-6e161aa458ac tempest-AttachVolumeTestJSON-1934365025 tempest-AttachVolumeTestJSON-1934365025-project] 10.222.0.36 "GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337" status: 404 len: 111 microversion: 2.1 time: 0.034944 Oct 31 15:02:32.214055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 405/764] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:02:32 2022] GET /compute/v2.1/servers/820c59dc-ee1a-4470-b9d6-14060ebd8337 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:02:32.214521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:32.215734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7ad64a96-d36d-4c2a-b193-88e390fcb31d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.208725 Oct 31 15:02:32.216277 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 360/765] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:32 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:33.243736 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:33.245448 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:33.257658 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:33.259814 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:33.260467 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:33.264919 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:33.269681 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:33.270285 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:33.605289 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:33.614874 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:33.618161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:33.619951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7847f8ff-758a-491c-b423-01e694a37e59 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.381192 Oct 31 15:02:33.621014 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 406/766] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:33 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:34.649745 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:34.650380 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:34.673498 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:34.673998 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:34.674504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:34.675234 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:34.675764 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:34.676221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:35.011415 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:35.024333 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:35.028037 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:35.030876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0da5a427-e61f-41f4-bcbb-67707f560990 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.385551 Oct 31 15:02:35.033600 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 361/767] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:34 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:36.069416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:36.071354 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:36.087216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:36.089907 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:36.099447 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:36.100255 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:36.100742 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:36.101171 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:36.345041 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:36.354582 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:36.356123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:36.357797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e64c21b6-2a85-4dc4-a058-8e95b759bdc7 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.292910 Oct 31 15:02:36.358538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 407/768] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:36 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:37.384180 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:37.386086 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:37.396427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:37.398074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:37.399220 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:37.399713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:37.400431 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:37.400888 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:37.401314 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:37.569435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:37.581947 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:37.583691 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:37.589467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-817b4001-201b-49de-b277-84cb4053dc31 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.204800 Oct 31 15:02:37.608472 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 362/769] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:37 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:38.616545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:38.618332 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:38.620405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:38.626726 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:38.627224 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:38.627685 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:38.628392 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:38.628848 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:38.629268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:38.804353 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:38.815301 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:38.816801 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:38.817961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7db71ee9-cfcf-425b-bc34-ba0a9381f625 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.205326 Oct 31 15:02:38.818514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 408/770] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:38 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:39.843847 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:39.844698 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:39.852004 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:39.852596 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:39.853135 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:39.853920 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:39.854482 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:39.855133 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:39.938549 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-46260e52-995c-4ccd-aa0c-340cfec4290e req-3f4ed54f-81f7-48cf-8d21-64731d944495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78da101-dab9-43eb-b75d-14baee21f5c0", "name": "network-vif-plugged", "status": "completed", "tag": "fad9b881-1f6a-40eb-9847-b09fa756357c"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:39.948843 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-46260e52-995c-4ccd-aa0c-340cfec4290e req-3f4ed54f-81f7-48cf-8d21-64731d944495 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:39.949495 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-46260e52-995c-4ccd-aa0c-340cfec4290e req-3f4ed54f-81f7-48cf-8d21-64731d944495 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:39.950073 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-46260e52-995c-4ccd-aa0c-340cfec4290e req-3f4ed54f-81f7-48cf-8d21-64731d944495 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:39.964161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-46260e52-995c-4ccd-aa0c-340cfec4290e req-3f4ed54f-81f7-48cf-8d21-64731d944495 service nova] Creating event network-vif-plugged:fad9b881-1f6a-40eb-9847-b09fa756357c for instance e78da101-dab9-43eb-b75d-14baee21f5c0 on hv-cinder-86022 Oct 31 15:02:39.969558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-46260e52-995c-4ccd-aa0c-340cfec4290e req-3f4ed54f-81f7-48cf-8d21-64731d944495 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034680 Oct 31 15:02:39.970463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 409/771] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:02:40.015930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:40.025889 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:40.028076 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:40.029846 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-fb7da32d-657c-461e-b7f8-cc9d323a276e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.189700 Oct 31 15:02:40.030726 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 363/772] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:39 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:41.063075 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:41.063075 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:41.064947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:41.065447 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:41.065866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:41.066562 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:41.067013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:41.067436 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:41.203450 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:41.213094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:41.214620 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:41.215852 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-017ac781-7e1c-4bbc-94ae-b779dd619154 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1731 microversion: 2.20 time: 0.163228 Oct 31 15:02:41.216579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 410/773] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:41 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:42.240682 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:42.241276 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:42.248365 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:42.248841 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:42.249288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:42.249982 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:42.250406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:42.250823 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:42.380087 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:42.388928 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:42.390370 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:02:42.391526 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d17e1347-65be-4ec2-b5e3-1bf2857dacf4 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1718 microversion: 2.20 time: 0.154777 Oct 31 15:02:42.392100 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 364/774] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:02:42 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:02:56.555891 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-75683e4f-7afc-40d2-922a-4f268eb715fd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:02:56.556431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-75683e4f-7afc-40d2-922a-4f268eb715fd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:56.558825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=5 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:56.559763 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=33 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:56.565951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-75683e4f-7afc-40d2-922a-4f268eb715fd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:56.566446 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-75683e4f-7afc-40d2-922a-4f268eb715fd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:56.566899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-75683e4f-7afc-40d2-922a-4f268eb715fd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:56.567614 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-75683e4f-7afc-40d2-922a-4f268eb715fd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:56.568074 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-75683e4f-7afc-40d2-922a-4f268eb715fd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:56.568577 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-75683e4f-7afc-40d2-922a-4f268eb715fd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:56.594601 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-75683e4f-7afc-40d2-922a-4f268eb715fd tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/ips" status: 200 len: 148 microversion: 2.1 time: 0.043154 Oct 31 15:02:56.595190 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 411/775] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 15:02:56 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:02:57.993611 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b3ab975d-c066-48fa-894d-244ad11e1612 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f504996a-990e-4a8a-bc7c-d86a4da3d504"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:02:57.995954 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b3ab975d-c066-48fa-894d-244ad11e1612 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:02:57.998617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=5 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:57.999269 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=30 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:58.005747 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b3ab975d-c066-48fa-894d-244ad11e1612 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:58.006230 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b3ab975d-c066-48fa-894d-244ad11e1612 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:58.006883 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b3ab975d-c066-48fa-894d-244ad11e1612 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:58.007768 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b3ab975d-c066-48fa-894d-244ad11e1612 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:02:58.008220 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b3ab975d-c066-48fa-894d-244ad11e1612 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:02:58.008640 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b3ab975d-c066-48fa-894d-244ad11e1612 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:02:58.277543 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b3ab975d-c066-48fa-894d-244ad11e1612 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "POST /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287855 Oct 31 15:02:58.278792 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 365/776] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:02:57 2022] POST /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:05.965176 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:05.965860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:05.974498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:05.975098 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:05.975537 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:05.977324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:05.977791 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:05.978224 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:06.066019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lazy-loading 'services' on Instance uuid adbc41e7-a0c8-411f-a862-74bba534647d {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:03:06.140401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-60080f72-727d-4736-8ee9-072a9354db00 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-volume_attachments/f504996a-990e-4a8a-bc7c-d86a4da3d504" status: 202 len: 0 microversion: 2.1 time: 0.179722 Oct 31 15:03:06.140774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 412/777] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:03:05 2022] DELETE /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-volume_attachments/f504996a-990e-4a8a-bc7c-d86a4da3d504 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:03:06.150993 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c5538c32-e740-48a9-9b8e-db1fa1a9e3ac tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:06.154352 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c5538c32-e740-48a9-9b8e-db1fa1a9e3ac tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:06.161757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5538c32-e740-48a9-9b8e-db1fa1a9e3ac tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:06.162374 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5538c32-e740-48a9-9b8e-db1fa1a9e3ac tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:06.162805 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5538c32-e740-48a9-9b8e-db1fa1a9e3ac tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:06.164196 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5538c32-e740-48a9-9b8e-db1fa1a9e3ac tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:06.164651 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5538c32-e740-48a9-9b8e-db1fa1a9e3ac tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:06.165252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5538c32-e740-48a9-9b8e-db1fa1a9e3ac tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:06.197174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c5538c32-e740-48a9-9b8e-db1fa1a9e3ac tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051934 Oct 31 15:03:06.197729 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 366/778] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:03:06 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:07.211769 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f4e3f6f9-de9b-4875-8f90-01a2dd066faa tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:07.214102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f4e3f6f9-de9b-4875-8f90-01a2dd066faa tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:07.220722 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4e3f6f9-de9b-4875-8f90-01a2dd066faa tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:07.221191 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4e3f6f9-de9b-4875-8f90-01a2dd066faa tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:07.221619 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4e3f6f9-de9b-4875-8f90-01a2dd066faa tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:07.222299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4e3f6f9-de9b-4875-8f90-01a2dd066faa tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:07.222744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4e3f6f9-de9b-4875-8f90-01a2dd066faa tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:07.223160 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f4e3f6f9-de9b-4875-8f90-01a2dd066faa tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:07.252039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f4e3f6f9-de9b-4875-8f90-01a2dd066faa tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045839 Oct 31 15:03:07.252585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 413/779] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:03:07 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:03:07.316043 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:07.316669 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:07.323479 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:07.323987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:07.324418 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:07.325104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:07.325546 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:07.325961 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:07.350382 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:03:07.425670 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0dd36426-7149-4b5b-8a8c-e9aa66ed2234 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 204 len: 0 microversion: 2.1 time: 0.113420 Oct 31 15:03:07.426281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 367/780] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:03:07 2022] DELETE /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:03:07.435316 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:07.435969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:07.441754 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:07.442227 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:07.442650 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:07.443322 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:07.443788 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:07.444206 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:07.572155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:07.579821 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ff739aff-13c4-4921-952a-1476bc352bc0 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1678 microversion: 2.1 time: 0.148370 Oct 31 15:03:07.580380 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 414/781] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:07 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:08.604554 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:08.605244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:08.611738 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:08.612213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:08.612640 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:08.613315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:08.613756 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:08.614171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:08.751105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:08.759310 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4621b9cd-8b4d-46af-9638-b819200bce83 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1678 microversion: 2.1 time: 0.159119 Oct 31 15:03:08.759900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 368/782] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:08 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:09.784280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:09.785013 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:09.792191 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:09.792784 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:09.793402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:09.794190 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:09.794737 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:09.795338 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:09.937270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:09.945348 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-08746993-7e32-4632-b8dd-01409888da2e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1678 microversion: 2.1 time: 0.165781 Oct 31 15:03:09.946909 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 415/783] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:09 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:10.969484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:10.970096 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:10.976984 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:10.977457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:10.977891 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:10.978569 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:10.979017 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:10.979430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:11.112908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:11.121477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2b42ba1a-7588-47fa-8558-78f80d71697d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1678 microversion: 2.1 time: 0.155768 Oct 31 15:03:11.122047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 369/784] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:10 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:12.145276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:12.146039 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:12.153696 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:12.154189 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:12.154629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:12.155334 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:12.155846 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:12.156273 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:12.254490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:12.274288 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6d16297c-4b10-475d-a111-03b8f4cdd02c tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1610 microversion: 2.1 time: 0.132178 Oct 31 15:03:12.275228 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 416/785] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:12 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1610 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:12.756604 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-259c56c0-6108-4fb6-a28d-058216565621 req-2af15154-24d7-4e54-9c2c-84da9591b1bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbc41e7-a0c8-411f-a862-74bba534647d", "name": "network-vif-deleted", "tag": "0e848f26-da30-41e1-b524-98ff8a6a72e8"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:12.768575 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-259c56c0-6108-4fb6-a28d-058216565621 req-2af15154-24d7-4e54-9c2c-84da9591b1bc service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:12.769108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-259c56c0-6108-4fb6-a28d-058216565621 req-2af15154-24d7-4e54-9c2c-84da9591b1bc service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:12.769537 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-259c56c0-6108-4fb6-a28d-058216565621 req-2af15154-24d7-4e54-9c2c-84da9591b1bc service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:12.947082 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-259c56c0-6108-4fb6-a28d-058216565621 req-2af15154-24d7-4e54-9c2c-84da9591b1bc service nova] Creating event network-vif-deleted:0e848f26-da30-41e1-b524-98ff8a6a72e8 for instance adbc41e7-a0c8-411f-a862-74bba534647d on hv-cinder-86022 Oct 31 15:03:12.952979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-259c56c0-6108-4fb6-a28d-058216565621 req-2af15154-24d7-4e54-9c2c-84da9591b1bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199896 Oct 31 15:03:12.953598 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 370/786] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:13.298930 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:13.299845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:13.306545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:13.307418 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:13.308203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:13.309172 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:13.310147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:13.310802 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:13.389708 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:13.390972 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:13.391648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:13.392519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lazy-loading 'fault' on Instance uuid adbc41e7-a0c8-411f-a862-74bba534647d {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:03:13.447334 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcbcb2ed9e44dbe8444e531fc1eb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629aa044ca845069237ecb8d889284e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:13.459753 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ee71517b-4bd4-4bca-8496-967577bc24b8 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 200 len: 1329 microversion: 2.1 time: 0.164718 Oct 31 15:03:13.461717 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 417/787] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:13 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 1329 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:14.486786 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:14.487467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:14.494107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:14.494903 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:14.495334 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:14.496478 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:14.497341 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:14.498064 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:14.511659 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d HTTP/1.1 Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:03:14.513288 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:14.514878 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': 'adbc41e7-a0c8-411f-a862-74bba534647d'} Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:14.515790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:14.517045 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:14.518488 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:14.518488 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5a38862d-eb77-47bd-ab3a-9b8bd245e3ea tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 404 len: 111 microversion: 2.1 time: 0.032575 Oct 31 15:03:14.518488 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 371/788] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:14 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:14.528819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d5306bd9-c447-4d12-8df3-315424e11e5d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '.version_select at 0x7f6c746f1e50>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:14.550175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d5306bd9-c447-4d12-8df3-315424e11e5d tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-16116865" status: 202 len: 0 microversion: 2.1 time: 0.030105 Oct 31 15:03:14.550747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 418/789] 10.222.0.36 () {58 vars in 1215 bytes} [Mon Oct 31 15:03:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-16116865 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:03:18.451885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:18.452639 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:18.461659 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:18.462143 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:18.462570 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:18.463266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:18.463745 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:18.464308 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:18.478240 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: DELETE /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d HTTP/1.1 Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:03:18.479813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.481315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': 'adbc41e7-a0c8-411f-a862-74bba534647d'} Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:18.482174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.483909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.485505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:18.485505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c0a6c0f4-47b8-48eb-9978-a7ce43281dc6 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 404 len: 111 microversion: 2.1 time: 0.035016 Oct 31 15:03:18.485505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 372/790] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:03:18 2022] DELETE /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:18.491374 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:18.493015 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: adbc41e7-a0c8-411f-a862-74bba534647d] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:18.498950 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:18.499455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:18.499915 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:18.500606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:18.501055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:18.501474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:18.514815 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d HTTP/1.1 Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:03:18.516484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.518078 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': 'adbc41e7-a0c8-411f-a862-74bba534647d'} Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:18.520343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. Oct 31 15:03:18.521787 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:18.522911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance adbc41e7-a0c8-411f-a862-74bba534647d could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:18.522911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8cfb617a-1425-4008-904b-5961cc7eebe5 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d" status: 404 len: 111 microversion: 2.1 time: 0.031105 Oct 31 15:03:18.522911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 419/791] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:18 2022] GET /compute/v2.1/servers/adbc41e7-a0c8-411f-a862-74bba534647d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:19.663531 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:19.664270 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:19.671740 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:19.672220 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:19.672653 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:19.673352 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:19.673799 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:19.674217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:19.688438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: DELETE /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b HTTP/1.1 Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:03:19.689969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.691539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '9357fbec-cc10-4069-9fa4-fdeefcbe705b'} Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:19.692580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.694104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.696724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:19.696724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-df125593-a7ff-4f7c-ad32-346aa232f272 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 404 len: 111 microversion: 2.1 time: 0.031866 Oct 31 15:03:19.696724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 373/792] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:03:19 2022] DELETE /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:19.701912 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:19.702651 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 9357fbec-cc10-4069-9fa4-fdeefcbe705b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:19.709268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:19.709736 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:19.710502 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:19.711354 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:19.711831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:19.712255 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:19.725455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b HTTP/1.1 Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:03:19.727147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.728760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '9357fbec-cc10-4069-9fa4-fdeefcbe705b'} Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:19.729733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. Oct 31 15:03:19.731309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.732738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance 9357fbec-cc10-4069-9fa4-fdeefcbe705b could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:19.732738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f31d116e-5cac-4828-b6d2-71ab0fc14d09 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b" status: 404 len: 111 microversion: 2.1 time: 0.031019 Oct 31 15:03:19.732738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 420/793] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:19 2022] GET /compute/v2.1/servers/9357fbec-cc10-4069-9fa4-fdeefcbe705b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:19.737468 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:19.737979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:19.744593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:19.745068 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:19.745494 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:19.746173 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:19.746619 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:19.747062 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:19.762032 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: DELETE /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 HTTP/1.1 Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:03:19.763617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.765221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '19b5253e-385d-419d-9fdc-d04de43ab441'} Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:19.766085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.767900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.769174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:19.769174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7ffc82c7-2451-4342-9379-b70f19bfcf03 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 404 len: 111 microversion: 2.1 time: 0.031386 Oct 31 15:03:19.769174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 374/794] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:03:19 2022] DELETE /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:19.773850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:19.774450 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 19b5253e-385d-419d-9fdc-d04de43ab441] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:19.780322 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:19.780798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:19.781227 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:19.781902 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:19.782339 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:19.782753 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:19.797605 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 HTTP/1.1 Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:03:19.799146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.800903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '19b5253e-385d-419d-9fdc-d04de43ab441'} Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:19.801764 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. Oct 31 15:03:19.803033 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:19.805851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance 19b5253e-385d-419d-9fdc-d04de43ab441 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:19.805851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d7b87db9-4163-4f6f-b08a-8c21f95d50ef tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441" status: 404 len: 111 microversion: 2.1 time: 0.030523 Oct 31 15:03:19.805851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 421/795] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:19 2022] GET /compute/v2.1/servers/19b5253e-385d-419d-9fdc-d04de43ab441 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:20.944383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:20.945002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:20.951345 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:20.951844 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:20.952273 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:20.952945 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:20.953391 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:20.953800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:20.968104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: DELETE /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b HTTP/1.1 Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:03:20.969647 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:20.971183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '90f3404c-864a-4f8c-9444-8b3740b79f7b'} Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:20.972114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:20.973594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:20.975066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:20.975066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-114f5514-02fb-4cbc-8e50-d6c9fb9f57a9 tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 404 len: 111 microversion: 2.1 time: 0.030427 Oct 31 15:03:20.975066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 375/796] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:03:20 2022] DELETE /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:20.980249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:20.980855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] [instance: 90f3404c-864a-4f8c-9444-8b3740b79f7b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:20.987567 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:20.988062 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:20.988493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:20.989183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:20.989631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:20.990056 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:21.004918 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] HTTP exception thrown: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Request method failure captured: Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b HTTP/1.1 Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-I0Wb5KcVzetsUZ7OxoY0qMVtIffYP9mGxGicyppjHaJlkhzaZ1eH7OPOgQmEmbCPkHpB5A3FYpalXPpglvUO8EoagdwGZyOzeTVOWfrvbEfXUjwncM4Xem0O8v0DGje4URwe1x00iBIH4QIjA704bRGPfW3-aKBirH4jMvBjgvKxU Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:03:21.006397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f629aa044ca845069237ecb8d889284e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f629aa044ca845069237ecb8d889284e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f629aa044ca845069237ecb8d889284e"}]}] Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: f629aa044ca845069237ecb8d889284e Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046565151 Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: cdcbcb2ed9e44dbe8444e531fc1eb707 Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeNegativeTest-1046565151-project Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:21.007922 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '90f3404c-864a-4f8c-9444-8b3740b79f7b'} Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:21.008675 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. Oct 31 15:03:21.010217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:21.011476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] Returning 404 to user: Instance 90f3404c-864a-4f8c-9444-8b3740b79f7b could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:21.011476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-02a14ca3-99a8-4e58-afe3-3356655d982e tempest-AttachVolumeNegativeTest-1046565151 tempest-AttachVolumeNegativeTest-1046565151-project] 10.222.0.36 "GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b" status: 404 len: 111 microversion: 2.1 time: 0.032401 Oct 31 15:03:21.011476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 422/797] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:03:20 2022] GET /compute/v2.1/servers/90f3404c-864a-4f8c-9444-8b3740b79f7b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:24.291448 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8ca42929-bcf4-42e2-b980-0a88bee3fde6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:24.293757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8ca42929-bcf4-42e2-b980-0a88bee3fde6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:24.310388 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ca42929-bcf4-42e2-b980-0a88bee3fde6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:24.310891 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ca42929-bcf4-42e2-b980-0a88bee3fde6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:24.311325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ca42929-bcf4-42e2-b980-0a88bee3fde6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:24.313283 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ca42929-bcf4-42e2-b980-0a88bee3fde6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:24.314361 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ca42929-bcf4-42e2-b980-0a88bee3fde6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:24.315314 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8ca42929-bcf4-42e2-b980-0a88bee3fde6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:24.384478 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8ca42929-bcf4-42e2-b980-0a88bee3fde6 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.097143 Oct 31 15:03:24.388521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 376/798] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 31 15:03:24 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:03:24.484020 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:24.484522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:24.504840 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:24.505329 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:24.505757 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:24.507085 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:24.507582 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:24.508057 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:24.539526 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Going to try to terminate instance {{(pid=134339) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:03:24.674412 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-58f1139d-4690-4fac-98e9-fab5194c3b9d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 204 len: 0 microversion: 2.20 time: 0.196322 Oct 31 15:03:24.680115 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 423/799] 10.222.0.36 () {60 vars in 1280 bytes} [Mon Oct 31 15:03:24 2022] DELETE /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:03:24.686266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:24.687098 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:24.697109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:24.697893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:24.698526 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:24.703124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:24.704003 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:24.706201 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:24.970023 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:25.013899 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:25.017052 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:25.021121 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2a5cc454-7b5e-4c47-8559-d8555665c56d tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.339145 Oct 31 15:03:25.023581 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 377/800] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:03:24 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:03:26.055794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:26.057229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:26.064500 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:26.065299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:26.066040 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:26.067016 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:26.067476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:26.067957 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:26.227419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:26.236683 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:26.241403 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:26.242957 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7321f4c6-fe67-43fd-b494-59004a4e9984 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.192373 Oct 31 15:03:26.243859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 424/801] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:03:26 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:03:27.286517 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:27.287128 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:27.299475 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:27.300029 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:27.300475 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:27.301189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:27.301649 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:27.302074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:27.709211 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:27.729840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:27.739105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:27.740625 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-dc0bba08-59c9-4dea-ae34-631d5821171a tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1724 microversion: 2.20 time: 0.457906 Oct 31 15:03:27.742359 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 378/802] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:03:27 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1724 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:03:28.258903 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-ada84eca-b319-4d9b-8806-6971156b27f3 req-6b901911-c94d-4da1-b679-521b5a7dc142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78da101-dab9-43eb-b75d-14baee21f5c0", "name": "network-vif-deleted", "tag": "fad9b881-1f6a-40eb-9847-b09fa756357c"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:28.266421 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:28.279802 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-ada84eca-b319-4d9b-8806-6971156b27f3 req-6b901911-c94d-4da1-b679-521b5a7dc142 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:28.280543 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-ada84eca-b319-4d9b-8806-6971156b27f3 req-6b901911-c94d-4da1-b679-521b5a7dc142 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:28.281223 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-ada84eca-b319-4d9b-8806-6971156b27f3 req-6b901911-c94d-4da1-b679-521b5a7dc142 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:28.285468 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:28.302990 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-ada84eca-b319-4d9b-8806-6971156b27f3 req-6b901911-c94d-4da1-b679-521b5a7dc142 service nova] Creating event network-vif-deleted:fad9b881-1f6a-40eb-9847-b09fa756357c for instance e78da101-dab9-43eb-b75d-14baee21f5c0 on hv-cinder-86022 Oct 31 15:03:28.310839 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-ada84eca-b319-4d9b-8806-6971156b27f3 req-6b901911-c94d-4da1-b679-521b5a7dc142 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055522 Oct 31 15:03:28.312186 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 425/803] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:28.787444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:28.788976 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:28.806208 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:28.809219 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:28.811087 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:28.813002 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:28.816227 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:28.817098 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:28.817946 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:28.837421 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:28.943115 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:28.946048 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:28.947240 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:28.947959 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lazy-loading 'fault' on Instance uuid e78da101-dab9-43eb-b75d-14baee21f5c0 {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:03:29.035569 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:29.051813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:29.055358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1fb0b1657cd43baaa93a16ce6d9ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5119fe6e3c064da0a66218481a944aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:03:29.057730 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-03e3ce37-5107-46f9-a0bf-6fdcc4e7df79 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 200 len: 1371 microversion: 2.20 time: 0.287192 Oct 31 15:03:29.058989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 379/804] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:03:28 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:03:30.089845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:30.090679 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:30.098674 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:30.099276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:30.099971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:30.101677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:30.102216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:30.102711 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:30.118288 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] HTTP exception thrown: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Request method failure captured: Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 HTTP/1.1 Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-IpIM8HjEUg1xXYmWVF6XNHdYaimkvKsFm9frHgDf3FUxsEHeRiUdSVnUYrE1_E_SzTRJhFtK5QXbn0FsCpsVy98Oxf5AEinY4fZY70tpZQxCDGDbFvYrlDSR72E94nB8R-nCj1Aokgfr2Er59iB35wwDPF8c63uvn7kOjYfMqeIJU Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:03:30.120123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5119fe6e3c064da0a66218481a944aaa"}]}] Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: e1fb0b1657cd43baaa93a16ce6d9ec8f Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:30.121805 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': 'e78da101-dab9-43eb-b75d-14baee21f5c0'} Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:30.122709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:30.124947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:30.126260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Returning 404 to user: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:30.126260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-17e18dd8-3398-4689-865c-93c6eabe0956 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 404 len: 111 microversion: 2.20 time: 0.039140 Oct 31 15:03:30.128130 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 426/805] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:03:30 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:03:30.134050 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-56926d12-48af-4dda-998d-962ff3bf0dbf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '.version_select at 0x7f6c70ed34c0>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:30.155538 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-56926d12-48af-4dda-998d-962ff3bf0dbf tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-709641179" status: 204 len: 0 microversion: 2.20 time: 0.026091 Oct 31 15:03:30.156414 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 380/806] 10.222.0.36 () {60 vars in 1259 bytes} [Mon Oct 31 15:03:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-709641179 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 15:03:33.218610 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:33.220450 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:33.237989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:33.242880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:33.244036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:33.245149 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:33.245808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:33.246577 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:33.290566 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] HTTP exception thrown: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Request method failure captured: Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: DELETE /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 HTTP/1.1 Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-IpIM8HjEUg1xXYmWVF6XNHdYaimkvKsFm9frHgDf3FUxsEHeRiUdSVnUYrE1_E_SzTRJhFtK5QXbn0FsCpsVy98Oxf5AEinY4fZY70tpZQxCDGDbFvYrlDSR72E94nB8R-nCj1Aokgfr2Er59iB35wwDPF8c63uvn7kOjYfMqeIJU Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:03:33.293294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5119fe6e3c064da0a66218481a944aaa"}]}] Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: e1fb0b1657cd43baaa93a16ce6d9ec8f Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.294760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': 'e78da101-dab9-43eb-b75d-14baee21f5c0'} Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:33.295593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.296860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.300442 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Returning 404 to user: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:33.301819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-92688bc7-4722-47dd-b3fe-8269a004f810 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 404 len: 111 microversion: 2.20 time: 0.088795 Oct 31 15:03:33.306539 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 427/807] 10.222.0.36 () {60 vars in 1280 bytes} [Mon Oct 31 15:03:33 2022] DELETE /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:03:33.314781 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:33.315427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: e78da101-dab9-43eb-b75d-14baee21f5c0] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:33.324270 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:33.325438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:33.326075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:33.334284 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:33.337251 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:33.337920 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:33.362819 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] HTTP exception thrown: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Request method failure captured: Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 HTTP/1.1 Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-IpIM8HjEUg1xXYmWVF6XNHdYaimkvKsFm9frHgDf3FUxsEHeRiUdSVnUYrE1_E_SzTRJhFtK5QXbn0FsCpsVy98Oxf5AEinY4fZY70tpZQxCDGDbFvYrlDSR72E94nB8R-nCj1Aokgfr2Er59iB35wwDPF8c63uvn7kOjYfMqeIJU Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:03:33.364780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5119fe6e3c064da0a66218481a944aaa"}]}] Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: e1fb0b1657cd43baaa93a16ce6d9ec8f Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.367221 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': 'e78da101-dab9-43eb-b75d-14baee21f5c0'} Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:33.368080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. Oct 31 15:03:33.369608 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:33.383371 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Returning 404 to user: Instance e78da101-dab9-43eb-b75d-14baee21f5c0 could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:33.383371 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-129adbc1-1d8c-4b41-9dce-ee89a1813b1b tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0" status: 404 len: 111 microversion: 2.20 time: 0.071646 Oct 31 15:03:33.384917 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 381/808] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:03:33 2022] GET /compute/v2.1/servers/e78da101-dab9-43eb-b75d-14baee21f5c0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:03:36.685684 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-56b8ddbe-1bbb-49f6-bd8f-90d00feaabaa tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Action: 'create', calling method: .version_select at 0x7f6c747150d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-636517032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+9E0Bmj/m3fxca9k69mWectWg8tjGiC4LRnWtOdF4qMn9vbnv+El3BmgxKePntuYXAbufWFwpAYqErS+D1UnPYkc8SNuR1RVo5IMqWvWkmIDf8Eik/rQf2mleRE1TPEw=="}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:36.701560 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-56b8ddbe-1bbb-49f6-bd8f-90d00feaabaa tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Getting quotas for project 357cf607c19548859a14c92a4e90f148. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:03:36.705476 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-56b8ddbe-1bbb-49f6-bd8f-90d00feaabaa tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Getting quotas for user c6dc53b3c9e041a7ae977b8f9c4fb478 and project 357cf607c19548859a14c92a4e90f148. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:03:36.728776 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-56b8ddbe-1bbb-49f6-bd8f-90d00feaabaa tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.241409 Oct 31 15:03:36.729370 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 428/809] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 15:03:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:39.978916 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:39.979485 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:39.986473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:39.986961 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:39.987444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:39.988157 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:39.988603 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:39.989006 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:40.003302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] HTTP exception thrown: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Request method failure captured: Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: DELETE /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 HTTP/1.1 Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-IpIM8HjEUg1xXYmWVF6XNHdYaimkvKsFm9frHgDf3FUxsEHeRiUdSVnUYrE1_E_SzTRJhFtK5QXbn0FsCpsVy98Oxf5AEinY4fZY70tpZQxCDGDbFvYrlDSR72E94nB8R-nCj1Aokgfr2Er59iB35wwDPF8c63uvn7kOjYfMqeIJU Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:03:40.005457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5119fe6e3c064da0a66218481a944aaa"}]}] Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: e1fb0b1657cd43baaa93a16ce6d9ec8f Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.012289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '214568bd-3ebf-4f91-8153-d60959d49119'} Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:40.013142 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.014660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.016776 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Returning 404 to user: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:40.016776 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e2bf6c51-1587-4069-b2ad-36c0873389b2 tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "DELETE /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 404 len: 111 microversion: 2.20 time: 0.033070 Oct 31 15:03:40.016776 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 382/810] 10.222.0.36 () {60 vars in 1280 bytes} [Mon Oct 31 15:03:39 2022] DELETE /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:03:40.026062 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:40.027272 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] [instance: 214568bd-3ebf-4f91-8153-d60959d49119] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:03:40.040220 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:40.040786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:40.041305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:40.042395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:03:40.043165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:03:40.043774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:03:40.065023 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] HTTP exception thrown: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Request method failure captured: Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 HTTP/1.1 Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-IpIM8HjEUg1xXYmWVF6XNHdYaimkvKsFm9frHgDf3FUxsEHeRiUdSVnUYrE1_E_SzTRJhFtK5QXbn0FsCpsVy98Oxf5AEinY4fZY70tpZQxCDGDbFvYrlDSR72E94nB8R-nCj1Aokgfr2Er59iB35wwDPF8c63uvn7kOjYfMqeIJU Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:03:40.066680 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5119fe6e3c064da0a66218481a944aaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5119fe6e3c064da0a66218481a944aaa"}]}] Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 5119fe6e3c064da0a66218481a944aaa Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293236519 Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: e1fb0b1657cd43baaa93a16ce6d9ec8f Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293236519-project Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.068578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '214568bd-3ebf-4f91-8153-d60959d49119'} Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:40.069747 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. Oct 31 15:03:40.071352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:40.072748 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] Returning 404 to user: Instance 214568bd-3ebf-4f91-8153-d60959d49119 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:40.072748 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-38b8007a-770b-419f-bf6c-9b216c21322e tempest-AttachVolumeShelveTestJSON-1293236519 tempest-AttachVolumeShelveTestJSON-1293236519-project] 10.222.0.36 "GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119" status: 404 len: 111 microversion: 2.20 time: 0.054608 Oct 31 15:03:40.072748 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 429/811] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 31 15:03:40 2022] GET /compute/v2.1/servers/214568bd-3ebf-4f91-8153-d60959d49119 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:03:44.848415 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4e2b5928-5bf3-457a-a2fa-a5619fd1db5e tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Action: 'create', calling method: .version_select at 0x7f6c70d89670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-998929815"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:45.150787 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4e2b5928-5bf3-457a-a2fa-a5619fd1db5e tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.425689 Oct 31 15:03:45.151504 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 383/812] 10.222.0.36 () {60 vars in 1155 bytes} [Mon Oct 31 15:03:44 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 31 15:03:45.164601 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-770caa87-acb5-4756-a5dd-042fe399952b tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c746f1280>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:45.223174 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-770caa87-acb5-4756-a5dd-042fe399952b tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad" status: 200 len: 344 microversion: 2.1 time: 0.062751 Oct 31 15:03:45.224004 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 430/813] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 15:03:45 2022] GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:46.238930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e7d50af2-ee92-4249-8e07-3e14c50d04df tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c70c9d550>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:46.291850 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e7d50af2-ee92-4249-8e07-3e14c50d04df tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad" status: 200 len: 345 microversion: 2.1 time: 0.057447 Oct 31 15:03:46.292411 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 384/814] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 15:03:46 2022] GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:46.305821 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f1e861f7-3f04-4c0e-9bd1-be0f71063aee tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Action: 'create', calling method: .version_select at 0x7f6c74762940>, body: {"snapshot": {"volume_id": "01fbae48-963f-42b1-83fa-f778c22b57ad", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-560800024"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:46.504285 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f1e861f7-3f04-4c0e-9bd1-be0f71063aee tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.202698 Oct 31 15:03:46.511751 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 431/815] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 31 15:03:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:46.517846 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-92158472-4008-424e-b8b5-c131963d6d75 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c70f18550>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:46.560071 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-92158472-4008-424e-b8b5-c131963d6d75 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 200 len: 286 microversion: 2.1 time: 0.047385 Oct 31 15:03:46.560721 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 385/816] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:46 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:46.573233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cc01f6cc-9154-4c90-ae5b-c7d1e73007bb tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c74762ca0>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:46.617267 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cc01f6cc-9154-4c90-ae5b-c7d1e73007bb tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.048877 Oct 31 15:03:46.620402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 432/817] 10.222.0.36 () {58 vars in 1140 bytes} [Mon Oct 31 15:03:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:46.631972 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-11d3fcda-803f-46f9-ab86-ba1f2ad6e9ab tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c726e6280>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:46.667804 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-11d3fcda-803f-46f9-ab86-ba1f2ad6e9ab tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 200 len: 286 microversion: 2.1 time: 0.039763 Oct 31 15:03:46.673353 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 386/818] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:46 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:47.681241 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2c2c3273-16bb-41a8-9d58-d72ddefd8956 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c746f1310>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:47.687661 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=4 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:47.719846 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2c2c3273-16bb-41a8-9d58-d72ddefd8956 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 200 len: 286 microversion: 2.1 time: 0.043028 Oct 31 15:03:47.720529 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 433/819] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:47 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:48.733834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f21480d1-60ac-4c8c-8637-776ca481adaf tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c70ed34c0>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:48.771316 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f21480d1-60ac-4c8c-8637-776ca481adaf tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 200 len: 286 microversion: 2.1 time: 0.041053 Oct 31 15:03:48.776580 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 387/820] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:48 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:49.784236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9da36e74-5a52-43fc-a6bd-f57e782f3db7 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c747151f0>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:49.832560 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9da36e74-5a52-43fc-a6bd-f57e782f3db7 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 200 len: 286 microversion: 2.1 time: 0.050848 Oct 31 15:03:49.833710 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 434/821] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:49 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:50.842435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:50.843218 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=11 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:50.847183 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e53fa83b-f75f-4f20-ab08-186c1a01d80e tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c70f18430>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:50.898939 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e53fa83b-f75f-4f20-ab08-186c1a01d80e tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 200 len: 287 microversion: 2.1 time: 0.057562 Oct 31 15:03:50.899514 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 388/822] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:50 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:50.914662 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f80e37e5-0908-447b-b5a6-41ff8cad8426 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c74700b80>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:50.924003 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:50.925244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=7 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:50.987519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f80e37e5-0908-447b-b5a6-41ff8cad8426 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 202 len: 0 microversion: 2.1 time: 0.080130 Oct 31 15:03:50.988246 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 435/823] 10.222.0.36 () {58 vars in 1254 bytes} [Mon Oct 31 15:03:50 2022] DELETE /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:03:50.996456 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-dbad45ae-381a-45cb-948b-4d4322d0f64f tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c70f29f70>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:51.036028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-dbad45ae-381a-45cb-948b-4d4322d0f64f tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 200 len: 286 microversion: 2.1 time: 0.043454 Oct 31 15:03:51.038025 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 389/824] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:50 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:03:52.052306 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b289815d-9c3f-4642-9ea4-bee3cf074dc9 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c74762790>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:52.092750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b289815d-9c3f-4642-9ea4-bee3cf074dc9 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 200 len: 286 microversion: 2.1 time: 0.044489 Oct 31 15:03:52.099455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 436/825] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:52 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:53.106378 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e40f492d-c627-47c1-b16e-a1ac454a0482 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c70c9d4c0>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:53.139656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e40f492d-c627-47c1-b16e-a1ac454a0482 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 200 len: 286 microversion: 2.1 time: 0.037769 Oct 31 15:03:53.140215 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 390/826] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:53 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:54.155282 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cecf2489-11a7-476a-be84-ed1c5c7a1ff8 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c7473f430>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:54.210495 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-cecf2489-11a7-476a-be84-ed1c5c7a1ff8 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] HTTP exception thrown: Snapshot 5abda452-446f-43c8-bcb0-9d219d3759f4 could not be found. Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cecf2489-11a7-476a-be84-ed1c5c7a1ff8 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Request method failure captured: Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 HTTP/1.1 Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-PQfsfL0v0upIueLCpCjIwOhgsMflMKKvgGaNEXkVKbAOgBsoMLDD0n9ojs06EM1ES4dcVkbajqoYo4d3ZRv2334kS0DgmTfqAY5d7wsHquSD0ZGqt1qcPmS7IsOFYegwGrBIUY4UcpN0yJyiFzQDMtgUCNB04ZjNpC0MiL7qzKxOU Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 484a2d46e66049edbb8efb13ae810e25 Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:03:54.213625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/484a2d46e66049edbb8efb13ae810e25"}]}] Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 484a2d46e66049edbb8efb13ae810e25 Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-VolumesSnapshotsTestJSON-370145655-project Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 2fa86aaddd7d4f62a613c46c7ec296df Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-VolumesSnapshotsTestJSON-370145655-project Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Snapshot 5abda452-446f-43c8-bcb0-9d219d3759f4 could not be found. Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '5abda452-446f-43c8-bcb0-9d219d3759f4'} Oct 31 15:03:54.215094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5abda452-446f-43c8-bcb0-9d219d3759f4 could not be found. (HTTP 404) (Request-ID: req-685d7d70-8ef9-48a9-a8ef-41ddcb77c93e) Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:54.216357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:03:54.218010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5abda452-446f-43c8-bcb0-9d219d3759f4 could not be found. Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 31 15:03:54.220036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5abda452-446f-43c8-bcb0-9d219d3759f4 could not be found. Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5abda452-446f-43c8-bcb0-9d219d3759f4 could not be found. Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cecf2489-11a7-476a-be84-ed1c5c7a1ff8 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Returning 404 to user: Snapshot 5abda452-446f-43c8-bcb0-9d219d3759f4 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cecf2489-11a7-476a-be84-ed1c5c7a1ff8 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4" status: 404 len: 111 microversion: 2.1 time: 0.066053 Oct 31 15:03:54.221594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 437/827] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:03:54 2022] GET /compute/v2.1/os-snapshots/5abda452-446f-43c8-bcb0-9d219d3759f4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:54.224467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4bb9730d-3018-4309-8a38-cd55f2279eb2 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c70d89c10>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:54.414149 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4bb9730d-3018-4309-8a38-cd55f2279eb2 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad" status: 202 len: 0 microversion: 2.1 time: 0.193788 Oct 31 15:03:54.415454 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 391/828] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 15:03:54 2022] DELETE /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:03:54.438748 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c4c79ee4-2307-4316-8f01-b46d546a23c5 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c74700790>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:54.569820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c4c79ee4-2307-4316-8f01-b46d546a23c5 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad" status: 200 len: 344 microversion: 2.1 time: 0.150178 Oct 31 15:03:54.571415 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 438/829] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 15:03:54 2022] GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:03:55.586053 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-de189d27-17a5-47c9-aeac-80829e636658 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c70c9d430>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:55.640530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-de189d27-17a5-47c9-aeac-80829e636658 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] HTTP exception thrown: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-de189d27-17a5-47c9-aeac-80829e636658 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Request method failure captured: Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad HTTP/1.1 Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-PQfsfL0v0upIueLCpCjIwOhgsMflMKKvgGaNEXkVKbAOgBsoMLDD0n9ojs06EM1ES4dcVkbajqoYo4d3ZRv2334kS0DgmTfqAY5d7wsHquSD0ZGqt1qcPmS7IsOFYegwGrBIUY4UcpN0yJyiFzQDMtgUCNB04ZjNpC0MiL7qzKxOU Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 484a2d46e66049edbb8efb13ae810e25 Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:03:55.642911 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/484a2d46e66049edbb8efb13ae810e25"}]}] Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 484a2d46e66049edbb8efb13ae810e25 Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-VolumesSnapshotsTestJSON-370145655-project Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: 2fa86aaddd7d4f62a613c46c7ec296df Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-VolumesSnapshotsTestJSON-370145655-project Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '01fbae48-963f-42b1-83fa-f778c22b57ad'} Oct 31 15:03:55.644530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. (HTTP 404) (Request-ID: req-8c4fa7da-60c3-4a11-95fc-2b708f4e67db) Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:55.646074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:03:55.647506 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:03:55.651318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-de189d27-17a5-47c9-aeac-80829e636658 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Returning 404 to user: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:55.652840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-de189d27-17a5-47c9-aeac-80829e636658 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad" status: 404 len: 109 microversion: 2.1 time: 0.063471 Oct 31 15:03:55.656488 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 392/830] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 15:03:55 2022] GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:55.662442 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6999c3b7-c27b-4f9a-a25c-643fd4e49448 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c7473f3a0>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:55.725383 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-6999c3b7-c27b-4f9a-a25c-643fd4e49448 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] HTTP exception thrown: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6999c3b7-c27b-4f9a-a25c-643fd4e49448 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Request method failure captured: Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: DELETE /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad HTTP/1.1 Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-PQfsfL0v0upIueLCpCjIwOhgsMflMKKvgGaNEXkVKbAOgBsoMLDD0n9ojs06EM1ES4dcVkbajqoYo4d3ZRv2334kS0DgmTfqAY5d7wsHquSD0ZGqt1qcPmS7IsOFYegwGrBIUY4UcpN0yJyiFzQDMtgUCNB04ZjNpC0MiL7qzKxOU Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 484a2d46e66049edbb8efb13ae810e25 Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:03:55.728558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/484a2d46e66049edbb8efb13ae810e25"}]}] Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 484a2d46e66049edbb8efb13ae810e25 Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-VolumesSnapshotsTestJSON-370145655-project Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 2fa86aaddd7d4f62a613c46c7ec296df Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-VolumesSnapshotsTestJSON-370145655-project Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '01fbae48-963f-42b1-83fa-f778c22b57ad'} Oct 31 15:03:55.729856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. (HTTP 404) (Request-ID: req-dd6b6b24-8a7c-4189-819f-5964b5f4b8f3) Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:55.730667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:03:55.735911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 15:03:55.738517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6999c3b7-c27b-4f9a-a25c-643fd4e49448 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Returning 404 to user: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6999c3b7-c27b-4f9a-a25c-643fd4e49448 tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad" status: 404 len: 109 microversion: 2.1 time: 0.073203 Oct 31 15:03:55.741794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 439/831] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 31 15:03:55 2022] DELETE /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:03:55.744188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-954024c8-eafd-4bb5-9a7d-bfb147dde79e tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Calling method '.version_select at 0x7f6c70f298b0>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:03:55.806022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-954024c8-eafd-4bb5-9a7d-bfb147dde79e tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] HTTP exception thrown: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-954024c8-eafd-4bb5-9a7d-bfb147dde79e tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Request method failure captured: Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad HTTP/1.1 Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-PQfsfL0v0upIueLCpCjIwOhgsMflMKKvgGaNEXkVKbAOgBsoMLDD0n9ojs06EM1ES4dcVkbajqoYo4d3ZRv2334kS0DgmTfqAY5d7wsHquSD0ZGqt1qcPmS7IsOFYegwGrBIUY4UcpN0yJyiFzQDMtgUCNB04ZjNpC0MiL7qzKxOU Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 484a2d46e66049edbb8efb13ae810e25 Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:03:55.808028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_484a2d46e66049edbb8efb13ae810e25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/484a2d46e66049edbb8efb13ae810e25"}]}] Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 484a2d46e66049edbb8efb13ae810e25 Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-370145655 Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-VolumesSnapshotsTestJSON-370145655-project Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: 2fa86aaddd7d4f62a613c46c7ec296df Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-VolumesSnapshotsTestJSON-370145655-project Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '01fbae48-963f-42b1-83fa-f778c22b57ad'} Oct 31 15:03:55.809379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. (HTTP 404) (Request-ID: req-48c2a261-5f3f-4547-aad3-ec3abb700186) Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:55.810225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:03:55.811477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:03:55.815900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-954024c8-eafd-4bb5-9a7d-bfb147dde79e tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] Returning 404 to user: Volume 01fbae48-963f-42b1-83fa-f778c22b57ad could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:03:55.821384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-954024c8-eafd-4bb5-9a7d-bfb147dde79e tempest-VolumesSnapshotsTestJSON-370145655 tempest-VolumesSnapshotsTestJSON-370145655-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad" status: 404 len: 109 microversion: 2.1 time: 0.073254 Oct 31 15:03:55.828545 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 393/832] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 31 15:03:55 2022] GET /compute/v2.1/os-volumes/01fbae48-963f-42b1-83fa-f778c22b57ad => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:03:57.228892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-af063a26-6e7b-4934-aebf-e1e397cf3712 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Action: 'create', calling method: .version_select at 0x7f6c74762ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2106455873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIptIn0HZB+k1QrKgs/X7fR12voXFL20KUKv8JAYwsINXEyRUB79DfM+3+l37G+EWKW6Rlpwo1qpHXhdA179cJ8cE7yAb8iYlwoj3FE0cYq8qlXQkNBUEBYHK/nYh8VNfQ=="}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:03:57.248385 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-af063a26-6e7b-4934-aebf-e1e397cf3712 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Getting quotas for project d7f5a9331dd54d9e8b5033234cb1077a. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:03:57.253984 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-af063a26-6e7b-4934-aebf-e1e397cf3712 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Getting quotas for user f0b358738b5a46d8bc1db1da68040c8f and project d7f5a9331dd54d9e8b5033234cb1077a. Resources: {'key_pairs'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:03:57.280840 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-af063a26-6e7b-4934-aebf-e1e397cf3712 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.296385 Oct 31 15:03:57.281524 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 440/833] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 15:03:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:02.881562 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1512340641", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-636517032", "security_groups": [{"name": "tempest-secgroup-smoke-141197031"}], "networks": [{"uuid": "0fc6c91a-9e65-4b6a-ab10-7d33cb435534"}], "block_device_mapping_v2": [{"uuid": "2a44deab-2fb6-4f1c-813d-5a15bf7f8b63", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:02.999172 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] validate_networks() for [('0fc6c91a-9e65-4b6a-ab10-7d33cb435534', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:04:03.528991 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:04:03.529861 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:04:03.530328 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:04:03.530730 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:04:03.531249 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:04:03.540606 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:03.541101 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:03.541538 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:03.542269 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:03.542723 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:03.543144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:03.562044 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Getting quotas for project 357cf607c19548859a14c92a4e90f148. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:04:03.567843 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Getting quotas for user c6dc53b3c9e041a7ae977b8f9c4fb478 and project 357cf607c19548859a14c92a4e90f148. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:04:03.631661 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:04:03.633995 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a44deab-2fb6-4f1c-813d-5a15bf7f8b63',volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:04:03.780543 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0449fede-ea34-4b91-943f-4d53f6cc065e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.904783 Oct 31 15:04:03.781373 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 394/834] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:04:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:04:03.792313 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-83fe4072-01e1-416b-b324-9fe5a1c754f0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:03.793479 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-83fe4072-01e1-416b-b324-9fe5a1c754f0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:03.859276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-83fe4072-01e1-416b-b324-9fe5a1c754f0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:03.867450 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-83fe4072-01e1-416b-b324-9fe5a1c754f0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1088 microversion: 2.1 time: 0.078665 Oct 31 15:04:03.867892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 441/835] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:03 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:04.892158 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:04.892799 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:04.903835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:04.904697 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:04.905358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:04.906182 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:04.906736 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:04.907263 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:05.009744 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:05.021274 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a4797556-bba5-4128-8225-4d6c0f50fb41 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1194 microversion: 2.1 time: 0.134469 Oct 31 15:04:05.022337 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 395/836] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:04 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1194 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:06.049869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:06.051153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:06.059182 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:06.060138 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:06.062999 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:06.063838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:06.064482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:06.065086 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:06.240963 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:06.250122 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5364cc83-7a02-4ee5-9aee-fe5fc7ba084f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.204755 Oct 31 15:04:06.251401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 442/837] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:06 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:06.674619 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-9e9ce535-1d60-4898-b9ff-974dddf5d798 req-24d41009-da61-4617-9044-2c5943df35ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a84bc4d-cc6e-455f-a958-b9e62714400b", "tag": "14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:06.697669 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-9e9ce535-1d60-4898-b9ff-974dddf5d798 req-24d41009-da61-4617-9044-2c5943df35ee service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:06.698546 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-9e9ce535-1d60-4898-b9ff-974dddf5d798 req-24d41009-da61-4617-9044-2c5943df35ee service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:06.699392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-9e9ce535-1d60-4898-b9ff-974dddf5d798 req-24d41009-da61-4617-9044-2c5943df35ee service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:06.711774 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-9e9ce535-1d60-4898-b9ff-974dddf5d798 req-24d41009-da61-4617-9044-2c5943df35ee service nova] Creating event network-changed:14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae for instance 8a84bc4d-cc6e-455f-a958-b9e62714400b on hv-cinder-86022 Oct 31 15:04:06.717503 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-9e9ce535-1d60-4898-b9ff-974dddf5d798 req-24d41009-da61-4617-9044-2c5943df35ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047073 Oct 31 15:04:06.718723 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 396/838] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:07.276495 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:07.277883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:07.285252 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:07.285985 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:07.286456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:07.287156 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:07.288027 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:07.288458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:07.470880 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:07.481539 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-da78b357-7343-422b-bd65-ef92466e42e9 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.208981 Oct 31 15:04:07.482216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 443/839] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:07 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:08.508451 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:08.509831 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:08.519522 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:08.520039 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:08.520479 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:08.521194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:08.521646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:08.522069 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:08.695914 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:08.704185 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-26952cc7-c327-4d8c-a0c5-7ab65311f2b7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.201264 Oct 31 15:04:08.704985 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 397/840] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:08 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:09.729373 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:09.730579 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:09.738336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:09.739617 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:09.740234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:09.741265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:09.741993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:09.742896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:09.918577 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:09.932328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8752a3f1-5c17-4960-9f73-829503ba8334 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.205726 Oct 31 15:04:09.943855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 444/841] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:09 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:10.957490 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:10.958100 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:10.964946 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:10.966124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:10.966560 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:10.967249 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:10.967727 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:10.968235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:11.110488 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:11.119427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-77da9e7d-a323-47f7-94a1-93c4841ef665 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.165881 Oct 31 15:04:11.130646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 398/842] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:10 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:11.199946 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1385952636", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "networks": [{"uuid": "ec1489db-82f7-421f-84de-b1ffcdcc5c33"}]}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:11.265744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] validate_networks() for [('ec1489db-82f7-421f-84de-b1ffcdcc5c33', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:04:11.633892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:04:11.634308 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:04:11.634773 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:04:11.635200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:04:11.635629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:04:11.644309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:11.644779 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:11.645204 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:11.645915 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:11.646359 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:11.646774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:11.663301 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Getting quotas for project 3424a823161e49029c454a8818f7bd7f. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:04:11.667640 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Getting quotas for user 7b9ebf0c707045908f3950c7077b3554 and project 3424a823161e49029c454a8818f7bd7f. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:04:11.679741 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:04:11.682005 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:04:11.729270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d9e02754-6a9f-4d2e-84e0-0961b8c7b609 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533692 Oct 31 15:04:11.730406 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 445/843] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:04:11.742381 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-64b74935-90b4-46a9-9266-a74dfb7fc4e7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:11.742995 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-64b74935-90b4-46a9-9266-a74dfb7fc4e7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:11.812365 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-64b74935-90b4-46a9-9266-a74dfb7fc4e7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:11.820030 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-64b74935-90b4-46a9-9266-a74dfb7fc4e7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1219 microversion: 2.1 time: 0.082418 Oct 31 15:04:11.820589 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 399/844] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:11 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:12.142614 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:12.143249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:12.150530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:12.151017 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:12.151453 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:12.152171 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:12.152622 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:12.153040 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:12.294611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:12.302863 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3b9a6bde-1cc1-4e49-9854-7cdd50ac0998 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.164361 Oct 31 15:04:12.303651 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 446/845] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:12 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:12.843926 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:12.844906 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:12.853477 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:12.854046 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:12.854566 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:12.855449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:12.856040 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:12.856561 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:12.922618 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:12.930569 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1324efe7-94df-462f-aa60-a909fd59f9ca tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1279 microversion: 2.1 time: 0.091335 Oct 31 15:04:12.931358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 400/846] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:12 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:13.326469 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:13.328000 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:13.335391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:13.335905 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:13.336341 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:13.337037 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:13.337519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:13.337940 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:13.514255 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:13.523044 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9e2f8245-5a80-4982-83c2-84222d7249b0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.200596 Oct 31 15:04:13.523647 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 447/847] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:13 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:13.953961 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:13.954583 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:13.957349 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:13.963537 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:13.964051 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:13.964485 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:13.965209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:13.965642 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:13.966293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:14.261008 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:14.270836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-af67d829-e88b-41c2-ae82-d5be2ea7555b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1277 microversion: 2.1 time: 0.320518 Oct 31 15:04:14.271579 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 401/848] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:13 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1277 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:14.546163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:14.547030 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:14.553353 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:14.553843 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:14.554283 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:14.554984 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:14.555438 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:14.555893 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:14.713514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:14.722659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5ee8d9b4-4e81-43f9-804b-5bb4b6e39a09 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.180758 Oct 31 15:04:14.723706 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 448/849] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:14 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:15.260881 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-5c0fd8ec-1da7-49bc-ba80-f1cc9c431ad6 req-f7ed674e-cae6-4574-ba2c-df6e742a7223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c24a6b-5f69-4a62-82b3-bb4b270249f5", "tag": "fdee37ea-cef0-4ac9-a7f1-8bd62eb71286"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:15.275310 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-5c0fd8ec-1da7-49bc-ba80-f1cc9c431ad6 req-f7ed674e-cae6-4574-ba2c-df6e742a7223 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:15.276102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-5c0fd8ec-1da7-49bc-ba80-f1cc9c431ad6 req-f7ed674e-cae6-4574-ba2c-df6e742a7223 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:15.276823 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-5c0fd8ec-1da7-49bc-ba80-f1cc9c431ad6 req-f7ed674e-cae6-4574-ba2c-df6e742a7223 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:15.296949 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-5c0fd8ec-1da7-49bc-ba80-f1cc9c431ad6 req-f7ed674e-cae6-4574-ba2c-df6e742a7223 service nova] Creating event network-changed:fdee37ea-cef0-4ac9-a7f1-8bd62eb71286 for instance 80c24a6b-5f69-4a62-82b3-bb4b270249f5 on hv-cinder-86022 Oct 31 15:04:15.299247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:15.302104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:15.304101 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-5c0fd8ec-1da7-49bc-ba80-f1cc9c431ad6 req-f7ed674e-cae6-4574-ba2c-df6e742a7223 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051532 Oct 31 15:04:15.306130 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 402/850] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:04:15.311461 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:15.312028 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:15.312492 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:15.313200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:15.313657 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:15.314082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:15.468294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:15.476671 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f65b9482-69e0-4802-8db9-e9b7e4f1d6c9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1319 microversion: 2.1 time: 0.185389 Oct 31 15:04:15.477355 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 449/851] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:15 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:15.747091 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:15.747784 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:15.754630 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:15.755153 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:15.755614 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:15.756316 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:15.756771 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:15.757197 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:15.900914 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:15.908683 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2963385e-a7cd-41c1-b970-72b2107b76fc tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.166017 Oct 31 15:04:15.909252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 403/852] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:15 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:16.210752 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1762258975", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2106455873", "security_groups": [{"name": "tempest-secgroup-smoke-825469118"}], "block_device_mapping_v2": [{"uuid": "87feb45a-a547-4f7a-baff-592ae7194109", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3aa20268-e1a0-450c-8a2f-a6e3730c1b1e"}]}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:16.334766 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] validate_networks() for [('3aa20268-e1a0-450c-8a2f-a6e3730c1b1e', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:04:16.500013 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:16.500678 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:16.508965 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:16.509457 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:16.509885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:16.510592 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:16.511042 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:16.511465 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:16.793892 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:16.802490 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2228feda-23b2-48bc-8cd9-070b808d7054 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1319 microversion: 2.1 time: 0.306215 Oct 31 15:04:16.803359 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 404/853] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:16 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:16.915325 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:04:16.916113 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:04:16.916808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:04:16.917398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:04:16.918010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:04:16.929656 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:16.930301 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:16.931032 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:16.931260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:16.931638 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:16.932316 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:16.932899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:16.933445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:16.937884 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:16.938610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:16.939199 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:16.940115 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:16.942001 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:16.942617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:16.957107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Getting quotas for project d7f5a9331dd54d9e8b5033234cb1077a. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:04:16.963007 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Getting quotas for user f0b358738b5a46d8bc1db1da68040c8f and project d7f5a9331dd54d9e8b5033234cb1077a. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:04:17.030839 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:04:17.033087 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87feb45a-a547-4f7a-baff-592ae7194109',volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:04:17.138953 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:17.148044 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-295dbcc9-516b-4b03-b864-99b8c3b6fc28 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.221155 Oct 31 15:04:17.148606 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 405/854] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:16 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:17.194977 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-84e6084f-e745-4e2a-9ee9-00451551c928 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.988560 Oct 31 15:04:17.195792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 450/855] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:04:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:04:17.209537 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-15b3afcb-288c-4e61-abd9-cad58352e49d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:17.210368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-15b3afcb-288c-4e61-abd9-cad58352e49d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:17.274302 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-15b3afcb-288c-4e61-abd9-cad58352e49d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:17.281547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-15b3afcb-288c-4e61-abd9-cad58352e49d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1095 microversion: 2.1 time: 0.076776 Oct 31 15:04:17.282766 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 406/856] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:17 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:17.827028 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:17.827716 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:17.835614 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:17.836104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:17.836609 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:17.837309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:17.837755 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:17.838357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:17.993750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:18.001584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-74ffe552-5e7c-4e61-8ac3-c14f9fbf0d3b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1319 microversion: 2.1 time: 0.179167 Oct 31 15:04:18.002154 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 451/857] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:17 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:18.172882 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:18.173599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:18.182323 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:18.183030 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:18.183686 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:18.185866 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:18.186554 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:18.187247 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:18.306750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:18.307417 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:18.321403 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:18.322428 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:18.323294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:18.326011 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:18.327114 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:18.327979 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:18.417234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:18.448991 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ed9c9add-817b-4d9d-ad12-69d7464d1eff tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1201 microversion: 2.1 time: 0.146611 Oct 31 15:04:18.450859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 452/858] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:18 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1201 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:18.465752 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-db621a9a-6fc2-47e4-8da2-bf0899406964 req-1610bd4a-2f59-4a96-8e0f-a956b434e00d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a84bc4d-cc6e-455f-a958-b9e62714400b", "name": "network-vif-plugged", "status": "completed", "tag": "14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:18.478110 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-db621a9a-6fc2-47e4-8da2-bf0899406964 req-1610bd4a-2f59-4a96-8e0f-a956b434e00d service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:18.478672 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-db621a9a-6fc2-47e4-8da2-bf0899406964 req-1610bd4a-2f59-4a96-8e0f-a956b434e00d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:18.479194 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-db621a9a-6fc2-47e4-8da2-bf0899406964 req-1610bd4a-2f59-4a96-8e0f-a956b434e00d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:18.493493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-db621a9a-6fc2-47e4-8da2-bf0899406964 req-1610bd4a-2f59-4a96-8e0f-a956b434e00d service nova] Creating event network-vif-plugged:14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae for instance 8a84bc4d-cc6e-455f-a958-b9e62714400b on hv-cinder-86022 Oct 31 15:04:18.499735 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-db621a9a-6fc2-47e4-8da2-bf0899406964 req-1610bd4a-2f59-4a96-8e0f-a956b434e00d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047529 Oct 31 15:04:18.501394 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 453/859] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:18.562101 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:18.572986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2a3b3427-1fed-4c58-806c-e2b6af8c5be5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.404369 Oct 31 15:04:18.574308 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 407/860] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:18 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:19.026301 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:19.027059 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:19.033950 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:19.035068 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:19.035743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:19.036545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:19.037099 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:19.037625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:19.249091 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:19.271775 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e61ae980-9666-42e6-ba12-88c9e26f62bc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1319 microversion: 2.1 time: 0.249725 Oct 31 15:04:19.272589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 454/861] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:19 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:19.475632 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:19.476659 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:19.483406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:19.483937 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:19.484382 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:19.485082 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:19.485535 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:19.485962 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:19.601234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:19.602205 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:19.610924 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:19.611663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:19.613391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:19.615119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:19.615945 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:19.616678 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:19.705355 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:19.721164 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-417cc367-e8b2-4d84-b646-ba870b4f2a0b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.250594 Oct 31 15:04:19.722297 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 408/862] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:19 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:19.773560 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:19.781305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-831e1a86-b13a-4c0f-be29-91a48a39c63a tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1259 microversion: 2.1 time: 0.184981 Oct 31 15:04:19.781861 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 455/863] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:19 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:20.297270 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:20.297888 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:20.307159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:20.307885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:20.308725 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:20.310594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-7051ace8-f9c9-437e-b420-cfafa1622fd9 req-e32e5f00-7128-4730-9640-5212a6ec4d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95baeb64-0d66-4688-8450-ce141151856f", "tag": "110ccfc6-0f74-4a58-87e5-897a238a6b52"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:20.311098 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:20.311941 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:20.312669 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:20.336274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-7051ace8-f9c9-437e-b420-cfafa1622fd9 req-e32e5f00-7128-4730-9640-5212a6ec4d0f service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:20.336274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-7051ace8-f9c9-437e-b420-cfafa1622fd9 req-e32e5f00-7128-4730-9640-5212a6ec4d0f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:20.336274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-7051ace8-f9c9-437e-b420-cfafa1622fd9 req-e32e5f00-7128-4730-9640-5212a6ec4d0f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:20.350965 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-7051ace8-f9c9-437e-b420-cfafa1622fd9 req-e32e5f00-7128-4730-9640-5212a6ec4d0f service nova] Creating event network-changed:110ccfc6-0f74-4a58-87e5-897a238a6b52 for instance 95baeb64-0d66-4688-8450-ce141151856f on hv-cinder-86022 Oct 31 15:04:20.356482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-7051ace8-f9c9-437e-b420-cfafa1622fd9 req-e32e5f00-7128-4730-9640-5212a6ec4d0f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049472 Oct 31 15:04:20.357223 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 456/864] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:20.522798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-de7749fa-b453-4846-9027-650934c3acaa req-1f981456-4e10-4562-898b-c451a205dfff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c24a6b-5f69-4a62-82b3-bb4b270249f5", "name": "network-vif-plugged", "status": "completed", "tag": "fdee37ea-cef0-4ac9-a7f1-8bd62eb71286"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:20.532964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-de7749fa-b453-4846-9027-650934c3acaa req-1f981456-4e10-4562-898b-c451a205dfff service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:20.533382 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-de7749fa-b453-4846-9027-650934c3acaa req-1f981456-4e10-4562-898b-c451a205dfff service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:20.533911 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-de7749fa-b453-4846-9027-650934c3acaa req-1f981456-4e10-4562-898b-c451a205dfff service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:20.546064 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-de7749fa-b453-4846-9027-650934c3acaa req-1f981456-4e10-4562-898b-c451a205dfff service nova] Creating event network-vif-plugged:fdee37ea-cef0-4ac9-a7f1-8bd62eb71286 for instance 80c24a6b-5f69-4a62-82b3-bb4b270249f5 on hv-cinder-86022 Oct 31 15:04:20.551360 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-de7749fa-b453-4846-9027-650934c3acaa req-1f981456-4e10-4562-898b-c451a205dfff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033116 Oct 31 15:04:20.552096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 457/865] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:04:20.569500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:20.577426 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-cb30d973-712e-4027-b040-0f8048016059 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1319 microversion: 2.1 time: 0.284652 Oct 31 15:04:20.578208 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 409/866] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:20 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:20.744180 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:20.744868 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:20.751020 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:20.751502 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:20.751961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:20.752646 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:20.753784 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:20.754207 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:20.812144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:20.812811 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:20.819246 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:20.819766 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:20.820406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:20.821271 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:20.821718 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:20.822131 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:20.923656 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:20.936333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c2b7bc57-c931-410c-8884-b470bd79b5bd tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.196295 Oct 31 15:04:20.936925 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 458/867] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:20 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:20.986952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:20.994915 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f0d55152-f0c9-4266-bf95-c2441c9a0cb8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1442 microversion: 2.1 time: 0.193553 Oct 31 15:04:20.995461 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 410/868] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:20 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1442 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:21.017834 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:21.019053 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:21.021034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:21.027100 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:21.027629 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:21.028061 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:21.028741 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:21.029188 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:21.029606 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:21.169921 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:21.178626 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a5bf2d16-8d87-41d2-b8dc-0af54cd2f625 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1442 microversion: 2.1 time: 0.164971 Oct 31 15:04:21.179502 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 459/869] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:21 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:21.601876 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:21.603134 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:21.609595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:21.610078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:21.610505 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:21.611198 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:21.611673 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:21.612090 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:21.960595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:21.961197 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:21.968017 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:21.968509 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:21.968945 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:21.969646 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:21.970096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:21.970521 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:22.112600 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:22.120855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3a6b6551-7905-4320-a82a-ff99fd07fb9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.164169 Oct 31 15:04:22.121399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 460/870] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:21 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:04:22.202657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:22.210633 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3d6eef6b-10fe-4387-9468-212616cb5b4c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1319 microversion: 2.1 time: 0.612982 Oct 31 15:04:22.211205 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 411/871] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:21 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1319 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:23.145959 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:23.146575 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:23.153120 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:23.153598 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:23.154027 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:23.154720 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:23.155166 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:23.155602 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:23.235031 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:23.235798 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:23.249981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:23.250576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:23.251089 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:23.251898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:23.252629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:23.253744 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:23.322220 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:23.326165 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:23.333410 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-59ea994e-3511-42aa-9d0c-af780a46c268 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.191931 Oct 31 15:04:23.334109 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 461/872] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:23 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:23.510859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:23.519459 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0a276733-a05c-4649-bf8b-ec3dcc993cb5 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1508 microversion: 2.1 time: 0.289125 Oct 31 15:04:23.520399 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 412/873] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:23 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:23.829077 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-10734fc0-7d8a-4b20-8c4d-4ea2bc0fdd13 req-9c13ac7e-c842-4c88-8c9b-cf14cde43a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a84bc4d-cc6e-455f-a958-b9e62714400b", "tag": "14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:23.842373 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-10734fc0-7d8a-4b20-8c4d-4ea2bc0fdd13 req-9c13ac7e-c842-4c88-8c9b-cf14cde43a72 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:23.843219 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-10734fc0-7d8a-4b20-8c4d-4ea2bc0fdd13 req-9c13ac7e-c842-4c88-8c9b-cf14cde43a72 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:23.843783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-10734fc0-7d8a-4b20-8c4d-4ea2bc0fdd13 req-9c13ac7e-c842-4c88-8c9b-cf14cde43a72 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:23.855994 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-10734fc0-7d8a-4b20-8c4d-4ea2bc0fdd13 req-9c13ac7e-c842-4c88-8c9b-cf14cde43a72 service nova] Creating event network-changed:14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae for instance 8a84bc4d-cc6e-455f-a958-b9e62714400b on hv-cinder-86022 Oct 31 15:04:23.861595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-10734fc0-7d8a-4b20-8c4d-4ea2bc0fdd13 req-9c13ac7e-c842-4c88-8c9b-cf14cde43a72 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037666 Oct 31 15:04:23.862552 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 462/874] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:24.356885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:24.358784 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:24.367908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:24.368535 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:24.368996 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:24.369746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:24.370204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:24.370643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:24.602275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:24.610024 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c5a181c5-26ac-4910-b92a-940a62511bec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.257077 Oct 31 15:04:24.610757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 413/875] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:24 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:25.634150 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:25.635233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:25.641200 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:25.641736 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:25.642183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:25.643543 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:25.644477 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:25.644914 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:25.786883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:25.794936 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-76d01135-8b4f-415f-9f80-595871c78939 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.165368 Oct 31 15:04:25.795507 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 463/876] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:25 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:26.819293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:26.819984 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:26.826392 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:26.826885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:26.827315 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:26.828026 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:26.828472 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:26.828887 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:26.848643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=100 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:26.971098 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:26.979286 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3dab92ad-e4c7-4646-b993-7c95f118179c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.165104 Oct 31 15:04:26.979881 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 414/877] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:26 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:28.003203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:28.003868 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:28.006413 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=4 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:28.007071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=18 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:28.013738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:28.014226 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:28.014663 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:28.015351 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:28.015838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:28.016254 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:28.156801 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:28.165247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2681bec7-818a-42b0-b884-accd8835458d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.166093 Oct 31 15:04:28.165803 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 464/878] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:27 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:29.188195 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:29.188839 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:29.190721 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=10 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:29.197598 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:29.198080 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:29.198507 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:29.199204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:29.199677 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:29.200092 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:29.339217 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:29.347636 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c33287fa-309a-45f8-96da-6b788f919213 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.163415 Oct 31 15:04:29.348160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 415/879] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:29 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:30.370246 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:30.370871 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:30.378478 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:30.378990 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:30.379429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:30.380170 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:30.380620 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:30.381068 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:30.518499 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:30.528042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-9cebfde6-d4a8-4ab5-8ee5-88b9c4e8596f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.161324 Oct 31 15:04:30.529104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 465/880] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:30 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:31.553298 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:31.553924 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:31.560613 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:31.561103 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:31.561542 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:31.562253 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:31.562692 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:31.563119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:31.701379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:31.710610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7d9c36eb-50ef-484d-ae54-9c2e326af80a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.162257 Oct 31 15:04:31.711199 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 416/881] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:31 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:32.224181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-7484d466-cdac-47f4-908e-706e66d77c19 req-79b01e8b-c8be-4ca4-b03d-0f6e96f24895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95baeb64-0d66-4688-8450-ce141151856f", "name": "network-vif-plugged", "status": "completed", "tag": "110ccfc6-0f74-4a58-87e5-897a238a6b52"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:32.234117 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-7484d466-cdac-47f4-908e-706e66d77c19 req-79b01e8b-c8be-4ca4-b03d-0f6e96f24895 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:32.234613 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-7484d466-cdac-47f4-908e-706e66d77c19 req-79b01e8b-c8be-4ca4-b03d-0f6e96f24895 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:32.235048 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-7484d466-cdac-47f4-908e-706e66d77c19 req-79b01e8b-c8be-4ca4-b03d-0f6e96f24895 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:32.246671 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-7484d466-cdac-47f4-908e-706e66d77c19 req-79b01e8b-c8be-4ca4-b03d-0f6e96f24895 service nova] Creating event network-vif-plugged:110ccfc6-0f74-4a58-87e5-897a238a6b52 for instance 95baeb64-0d66-4688-8450-ce141151856f on hv-cinder-86022 Oct 31 15:04:32.251611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-7484d466-cdac-47f4-908e-706e66d77c19 req-79b01e8b-c8be-4ca4-b03d-0f6e96f24895 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Oct 31 15:04:32.252776 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 466/882] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:32.739098 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:32.740099 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:32.749018 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:32.749590 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:32.750140 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:32.751094 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:32.751576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:32.752281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:32.889990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:32.898249 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9313354e-280a-450d-ac22-b70dfe83847e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.166379 Oct 31 15:04:32.898824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 417/883] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:32 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:33.922404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:33.923098 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:33.934588 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:33.935306 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:33.935786 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:33.936496 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:33.936951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:33.937376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:34.093258 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:34.103852 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-737c1681-5169-4333-aa65-882b713afb52 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1266 microversion: 2.1 time: 0.186090 Oct 31 15:04:34.104428 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 467/884] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:33 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:35.128774 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:35.129397 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:35.131795 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:35.137078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:35.137570 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:35.138010 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:35.138708 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:35.139177 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:35.139614 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:35.276027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:35.284549 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-47a0f44e-a738-4418-a50c-f23fe8dca4ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1452 microversion: 2.1 time: 0.159605 Oct 31 15:04:35.285120 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 418/885] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:35 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:35.306875 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:35.307482 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:35.314227 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:35.314807 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:35.315244 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:35.315981 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:35.316428 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:35.316855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:35.452626 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:04:35.460915 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-3fdcea74-4ab2-41d0-a7d2-413e901cb9c3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1452 microversion: 2.1 time: 0.157930 Oct 31 15:04:35.461470 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 468/886] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:04:35 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:04:37.715036 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-4053ffca-14e7-434b-9438-78e961f36f8e req-f6879b0f-1cfe-443c-8438-71fca5562e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95baeb64-0d66-4688-8450-ce141151856f", "tag": "110ccfc6-0f74-4a58-87e5-897a238a6b52"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:37.724378 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-4053ffca-14e7-434b-9438-78e961f36f8e req-f6879b0f-1cfe-443c-8438-71fca5562e2d service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:37.724853 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-4053ffca-14e7-434b-9438-78e961f36f8e req-f6879b0f-1cfe-443c-8438-71fca5562e2d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:37.725297 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-4053ffca-14e7-434b-9438-78e961f36f8e req-f6879b0f-1cfe-443c-8438-71fca5562e2d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:37.739576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-4053ffca-14e7-434b-9438-78e961f36f8e req-f6879b0f-1cfe-443c-8438-71fca5562e2d service nova] Creating event network-changed:110ccfc6-0f74-4a58-87e5-897a238a6b52 for instance 95baeb64-0d66-4688-8450-ce141151856f on hv-cinder-86022 Oct 31 15:04:37.749303 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-4053ffca-14e7-434b-9438-78e961f36f8e req-f6879b0f-1cfe-443c-8438-71fca5562e2d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270355 Oct 31 15:04:37.753059 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 419/887] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:43.095851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-41138252-c104-48c4-bb7f-e0bf81dcf14d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7c20f82-3e38-460f-a70a-324a4d415d1c", "device": "/dev/sdb"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:04:43.099320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-41138252-c104-48c4-bb7f-e0bf81dcf14d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:04:43.105600 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-41138252-c104-48c4-bb7f-e0bf81dcf14d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:43.106084 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-41138252-c104-48c4-bb7f-e0bf81dcf14d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:43.106520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-41138252-c104-48c4-bb7f-e0bf81dcf14d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:43.107247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-41138252-c104-48c4-bb7f-e0bf81dcf14d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:43.107723 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-41138252-c104-48c4-bb7f-e0bf81dcf14d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:43.108147 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-41138252-c104-48c4-bb7f-e0bf81dcf14d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:43.379773 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-41138252-c104-48c4-bb7f-e0bf81dcf14d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "POST /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288583 Oct 31 15:04:43.380638 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 469/888] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:04:43 2022] POST /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:07.068475 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:07.069247 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=28 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:07.073944 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:07.074519 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:07.082068 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:07.082547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:07.082976 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:07.083698 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:07.084152 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:07.084570 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:07.169185 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lazy-loading 'services' on Instance uuid 80c24a6b-5f69-4a62-82b3-bb4b270249f5 {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:05:07.242907 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0213eb22-9ed6-46cc-ad33-289d251d0bda tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "DELETE /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5/os-volume_attachments/e7c20f82-3e38-460f-a70a-324a4d415d1c" status: 202 len: 0 microversion: 2.1 time: 0.176194 Oct 31 15:05:07.243518 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 420/889] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:05:07 2022] DELETE /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5/os-volume_attachments/e7c20f82-3e38-460f-a70a-324a4d415d1c => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:05:08.376924 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:08.377515 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:08.380055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=21 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:08.380823 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:08.387993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:08.388523 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:08.388960 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:08.389676 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:08.390125 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:08.391115 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:08.418017 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Going to try to terminate instance {{(pid=134339) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:05:08.494179 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0bd66c5a-ae18-4fbf-92b0-bbf31236c827 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "DELETE /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 204 len: 0 microversion: 2.1 time: 0.121213 Oct 31 15:05:08.494774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 470/890] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:05:08 2022] DELETE /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:05:08.504576 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:08.505298 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:08.511523 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:08.512038 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:08.512467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:08.513147 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:08.513599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:08.514021 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:08.653147 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:08.661551 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-94e2d25b-180d-4252-af27-fb004c6c4049 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1514 microversion: 2.1 time: 0.162189 Oct 31 15:05:08.662119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 421/891] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:08 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:09.686531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:09.687751 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:09.694584 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:09.695067 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:09.695506 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:09.696224 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:09.696674 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:09.697096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:09.826830 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:09.835526 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1872c2e5-c4e7-40f6-838e-6c5f60b814de tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1514 microversion: 2.1 time: 0.153139 Oct 31 15:05:09.836141 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 471/892] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:09 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:10.858730 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:10.859906 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:10.867479 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:10.867994 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:10.868430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:10.869159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:10.869615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:10.870109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:10.882161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-6eba99da-37b4-4e6c-8961-9e0a73bde10d req-6b54b2d6-f85e-4037-bbd1-4fda57adb78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c24a6b-5f69-4a62-82b3-bb4b270249f5", "name": "network-vif-deleted", "tag": "fdee37ea-cef0-4ac9-a7f1-8bd62eb71286"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:10.892863 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-6eba99da-37b4-4e6c-8961-9e0a73bde10d req-6b54b2d6-f85e-4037-bbd1-4fda57adb78c service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:10.893478 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-6eba99da-37b4-4e6c-8961-9e0a73bde10d req-6b54b2d6-f85e-4037-bbd1-4fda57adb78c service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:10.893751 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-6eba99da-37b4-4e6c-8961-9e0a73bde10d req-6b54b2d6-f85e-4037-bbd1-4fda57adb78c service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:10.907472 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-6eba99da-37b4-4e6c-8961-9e0a73bde10d req-6b54b2d6-f85e-4037-bbd1-4fda57adb78c service nova] Creating event network-vif-deleted:fdee37ea-cef0-4ac9-a7f1-8bd62eb71286 for instance 80c24a6b-5f69-4a62-82b3-bb4b270249f5 on hv-cinder-86022 Oct 31 15:05:10.913556 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-6eba99da-37b4-4e6c-8961-9e0a73bde10d req-6b54b2d6-f85e-4037-bbd1-4fda57adb78c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034997 Oct 31 15:05:10.914919 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 472/893] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:10.944979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:10.952691 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-fe9baf66-c385-4f26-95ee-2031faed4621 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 200 len: 1472 microversion: 2.1 time: 0.097900 Oct 31 15:05:10.953316 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 422/894] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:10 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 1472 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:11.978541 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:11.979237 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 80c24a6b-5f69-4a62-82b3-bb4b270249f5] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:11.985591 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:11.986070 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:11.986504 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:11.987194 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:11.987667 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:11.988091 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:12.001779 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] HTTP exception thrown: Instance 80c24a6b-5f69-4a62-82b3-bb4b270249f5 could not be found. Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Request method failure captured: Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 HTTP/1.1 Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-PpiYvqcl5gCSE77s9lMKiL7K34k_tgFmBDk3sa4Z85UYRSeZ09OhB7NcBVMEl_KDeGtXjZKsJZ-7nS-pMoUUOWE63M1nrBuKHhpqXrvrmFC0kjaEr8uPiCM_7snHdVG2GPcdRJpmEOKqb5kaAsKGuMoZXFXnkkHCRfSmU-iVLwjqo Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 3424a823161e49029c454a8818f7bd7f Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1183103503 Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:05:12.003399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3424a823161e49029c454a8818f7bd7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3424a823161e49029c454a8818f7bd7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3424a823161e49029c454a8818f7bd7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3424a823161e49029c454a8818f7bd7f"}]}] Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-VolumesSnapshotTestJSON-1183103503 Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 3424a823161e49029c454a8818f7bd7f Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1183103503 Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-VolumesSnapshotTestJSON-1183103503-project Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 7b9ebf0c707045908f3950c7077b3554 Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-VolumesSnapshotTestJSON-1183103503-project Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 80c24a6b-5f69-4a62-82b3-bb4b270249f5 could not be found. Oct 31 15:05:12.005119 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '80c24a6b-5f69-4a62-82b3-bb4b270249f5'} Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c24a6b-5f69-4a62-82b3-bb4b270249f5 could not be found. Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:05:12.006525 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c24a6b-5f69-4a62-82b3-bb4b270249f5 could not be found. Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c24a6b-5f69-4a62-82b3-bb4b270249f5 could not be found. Oct 31 15:05:12.009347 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:05:12.011642 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Returning 404 to user: Instance 80c24a6b-5f69-4a62-82b3-bb4b270249f5 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:05:12.011642 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-fc298147-32dd-4b77-89ba-853d40d8e763 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5" status: 404 len: 111 microversion: 2.1 time: 0.031034 Oct 31 15:05:12.011642 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 473/895] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:11 2022] GET /compute/v2.1/servers/80c24a6b-5f69-4a62-82b3-bb4b270249f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:05:21.901757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-976109461", "imageRef": "b3e41275-7c16-45fe-8cc4-c748ff4a261d", "flavorRef": "452", "networks": [{"uuid": "ec1489db-82f7-421f-84de-b1ffcdcc5c33"}]}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:21.911499 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=6 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:21.912188 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:21.958809 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] validate_networks() for [('ec1489db-82f7-421f-84de-b1ffcdcc5c33', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:05:22.545487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:05:22.545905 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:05:22.546924 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:05:22.547363 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:05:22.547787 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:05:22.556514 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:22.557019 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:22.557450 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:22.558173 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:22.558623 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:22.559041 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:22.576705 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Getting quotas for project 3424a823161e49029c454a8818f7bd7f. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:05:22.580718 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Getting quotas for user 7b9ebf0c707045908f3950c7077b3554 and project 3424a823161e49029c454a8818f7bd7f. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:05:22.591652 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:05:22.593943 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3e41275-7c16-45fe-8cc4-c748ff4a261d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:05:22.639725 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d3938887-3fe3-4f7c-99fe-dd1cb0a653e3 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741806 Oct 31 15:05:22.646468 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 423/896] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:05:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:05:22.651594 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-06771275-0707-400f-9ce5-f04bb81e5271 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:22.652210 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-06771275-0707-400f-9ce5-f04bb81e5271 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:22.654765 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:22.667300 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:22.730689 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-06771275-0707-400f-9ce5-f04bb81e5271 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:22.752883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-06771275-0707-400f-9ce5-f04bb81e5271 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1218 microversion: 2.1 time: 0.105103 Oct 31 15:05:22.753431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 474/897] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:22 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:23.776592 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:23.777305 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:23.785203 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:23.785687 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:23.786611 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:23.786824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:23.787270 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:23.787834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:23.871118 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:23.879697 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3d6a47d3-e6fb-4390-8158-cf0d49338cee tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1288 microversion: 2.1 time: 0.106950 Oct 31 15:05:23.880272 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 424/898] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:23 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:24.902179 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:24.902831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:24.910391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:24.910872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:24.911295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:24.912006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:24.912448 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:24.912869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:25.043573 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:25.052229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-98549b92-71df-4572-a8d1-2f7399d8a2f6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1318 microversion: 2.1 time: 0.153829 Oct 31 15:05:25.052816 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 475/899] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:24 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:25.074966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-dac47e91-d902-4ebb-9176-e9fc59d9ff74 req-b0e429f6-b381-4a6c-b0c8-de6a56c8f3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65daa3d7-d3fb-4112-9c68-4dc2158675ea", "tag": "0fe94d1d-11dc-4f32-8bfc-c635d9bc836a"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:25.088214 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-dac47e91-d902-4ebb-9176-e9fc59d9ff74 req-b0e429f6-b381-4a6c-b0c8-de6a56c8f3ec service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:25.088685 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-dac47e91-d902-4ebb-9176-e9fc59d9ff74 req-b0e429f6-b381-4a6c-b0c8-de6a56c8f3ec service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:25.089114 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-dac47e91-d902-4ebb-9176-e9fc59d9ff74 req-b0e429f6-b381-4a6c-b0c8-de6a56c8f3ec service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:25.102535 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-dac47e91-d902-4ebb-9176-e9fc59d9ff74 req-b0e429f6-b381-4a6c-b0c8-de6a56c8f3ec service nova] Creating event network-changed:0fe94d1d-11dc-4f32-8bfc-c635d9bc836a for instance 65daa3d7-d3fb-4112-9c68-4dc2158675ea on hv-cinder-86022 Oct 31 15:05:25.107866 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-dac47e91-d902-4ebb-9176-e9fc59d9ff74 req-b0e429f6-b381-4a6c-b0c8-de6a56c8f3ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036576 Oct 31 15:05:25.108489 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 425/900] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:05:26.077157 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:26.077895 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:26.084272 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:26.084753 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:26.085182 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:26.085860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:26.086299 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:26.086714 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:26.215186 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:26.223673 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-770e70e5-5ce9-4481-9667-fcca3e8df183 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1318 microversion: 2.1 time: 0.150346 Oct 31 15:05:26.224239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 476/901] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:26 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:27.246598 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:27.247300 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:27.254703 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:27.255185 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:27.255649 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:27.256403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:27.256856 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:27.257296 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:27.393397 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:27.401088 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4a6069ef-2da9-490d-8175-f8dd3cdc64c6 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1318 microversion: 2.1 time: 0.158679 Oct 31 15:05:27.401652 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 426/902] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:27 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:28.423941 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:28.424569 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:28.431423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:28.431942 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:28.432376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:28.433082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:28.433531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:28.433950 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:28.590223 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:28.600005 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-143fa12a-3146-4c6d-b207-0cc0539ce9be tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1318 microversion: 2.1 time: 0.180197 Oct 31 15:05:28.600946 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 477/903] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:28 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:29.624264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:29.625155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:29.631695 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:29.632178 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:29.632612 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:29.633299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:29.633750 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:29.634173 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:29.766407 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:29.773943 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-28d23ae2-18b6-4339-b391-3361e82514b9 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1318 microversion: 2.1 time: 0.153578 Oct 31 15:05:29.774492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 427/904] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:29 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:30.596298 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-8c9031fd-dffd-4cfd-8b51-6733243c8a2a req-5755aff7-a044-4bba-9b82-3ff991324315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65daa3d7-d3fb-4112-9c68-4dc2158675ea", "name": "network-vif-plugged", "status": "completed", "tag": "0fe94d1d-11dc-4f32-8bfc-c635d9bc836a"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:30.607212 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-8c9031fd-dffd-4cfd-8b51-6733243c8a2a req-5755aff7-a044-4bba-9b82-3ff991324315 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:30.607735 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-8c9031fd-dffd-4cfd-8b51-6733243c8a2a req-5755aff7-a044-4bba-9b82-3ff991324315 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:30.608163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-8c9031fd-dffd-4cfd-8b51-6733243c8a2a req-5755aff7-a044-4bba-9b82-3ff991324315 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:30.619405 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-8c9031fd-dffd-4cfd-8b51-6733243c8a2a req-5755aff7-a044-4bba-9b82-3ff991324315 service nova] Creating event network-vif-plugged:0fe94d1d-11dc-4f32-8bfc-c635d9bc836a for instance 65daa3d7-d3fb-4112-9c68-4dc2158675ea on hv-cinder-86022 Oct 31 15:05:30.624305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-8c9031fd-dffd-4cfd-8b51-6733243c8a2a req-5755aff7-a044-4bba-9b82-3ff991324315 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031687 Oct 31 15:05:30.625659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 478/905] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:30.797500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:30.798111 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:30.804613 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:30.805097 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:30.805533 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:30.806230 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:30.806683 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:30.807107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:30.937847 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:30.946058 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0c1f44fc-57e5-41e4-b6d4-0647344e07aa tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1318 microversion: 2.1 time: 0.153251 Oct 31 15:05:30.946629 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 428/906] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:30 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:31.971164 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:31.971892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:31.978047 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:31.978531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:31.978968 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:31.979682 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:31.980139 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:31.980561 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:32.111030 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:32.118709 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-341a435f-67e8-44f2-a5c9-1d6599576d2c tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1318 microversion: 2.1 time: 0.153085 Oct 31 15:05:32.119263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 479/907] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:31 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:33.142330 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:33.142953 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:33.145144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:33.145798 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=6 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:33.151676 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:33.152155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:33.152585 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:33.153280 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:33.153728 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:33.154149 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:33.281979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:33.290001 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-26c192eb-3f69-4780-aab3-24f110cbbadc tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1506 microversion: 2.1 time: 0.152117 Oct 31 15:05:33.290561 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 429/908] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:33 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:33.313309 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-b5756604-56da-46c2-9a67-c7b2752b668d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6a77158-1352-4d9a-8bd1-dd642eaabcbd", "device": "/dev/sdb"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:33.315655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-b5756604-56da-46c2-9a67-c7b2752b668d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:33.317970 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:33.323874 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b5756604-56da-46c2-9a67-c7b2752b668d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:33.324354 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b5756604-56da-46c2-9a67-c7b2752b668d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:33.324782 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b5756604-56da-46c2-9a67-c7b2752b668d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:33.325463 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b5756604-56da-46c2-9a67-c7b2752b668d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:33.325906 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b5756604-56da-46c2-9a67-c7b2752b668d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:33.326320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-b5756604-56da-46c2-9a67-c7b2752b668d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:33.567604 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-b5756604-56da-46c2-9a67-c7b2752b668d tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "POST /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258613 Oct 31 15:05:33.568229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 480/909] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:05:33 2022] POST /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:05:50.860563 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:50.861128 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:50.863531 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:50.864314 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=34 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:50.871978 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:50.872460 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:50.872893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:50.874017 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:50.874439 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:50.874859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:50.958496 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lazy-loading 'services' on Instance uuid 65daa3d7-d3fb-4112-9c68-4dc2158675ea {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:05:51.028917 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5aea7a8c-2f7b-4889-9311-7120ced3325b tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "DELETE /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea/os-volume_attachments/f6a77158-1352-4d9a-8bd1-dd642eaabcbd" status: 202 len: 0 microversion: 2.1 time: 0.172170 Oct 31 15:05:51.029513 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 430/910] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:05:50 2022] DELETE /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea/os-volume_attachments/f6a77158-1352-4d9a-8bd1-dd642eaabcbd => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:05:52.162474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=16 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:52.163291 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:52.168080 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:52.168738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:52.178203 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:52.178769 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:52.179209 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:52.180080 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:52.180539 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:52.181008 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:52.211049 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Going to try to terminate instance {{(pid=134339) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:05:52.293289 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-92e1ae54-7151-4c2f-a459-919efbea5134 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "DELETE /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 204 len: 0 microversion: 2.1 time: 0.132345 Oct 31 15:05:52.294010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 481/911] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:05:52 2022] DELETE /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:05:52.303527 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:52.304275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:52.310486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:52.310970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:52.311407 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:52.312125 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:52.312574 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:52.312994 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:52.443605 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:52.451280 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-97f57e86-753a-420a-a60f-90c82a3d3b72 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1512 microversion: 2.1 time: 0.152794 Oct 31 15:05:52.451865 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 431/912] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:52 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:53.474265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:53.474948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:53.481406 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:53.481884 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:53.482313 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:53.482992 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:53.483441 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:53.483888 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:53.614950 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:53.622878 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7368dee0-69cf-4c77-9261-4e6be14e07ab tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1512 microversion: 2.1 time: 0.152995 Oct 31 15:05:53.623438 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 482/913] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:53 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:54.335987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-ada261a1-f608-44e9-a7fd-9eb56aeae39b req-91dc90b1-b08b-4323-bfe6-87ae248d9dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65daa3d7-d3fb-4112-9c68-4dc2158675ea", "name": "network-vif-deleted", "tag": "0fe94d1d-11dc-4f32-8bfc-c635d9bc836a"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:54.346408 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-ada261a1-f608-44e9-a7fd-9eb56aeae39b req-91dc90b1-b08b-4323-bfe6-87ae248d9dd6 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:54.346885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-ada261a1-f608-44e9-a7fd-9eb56aeae39b req-91dc90b1-b08b-4323-bfe6-87ae248d9dd6 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:54.347313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-ada261a1-f608-44e9-a7fd-9eb56aeae39b req-91dc90b1-b08b-4323-bfe6-87ae248d9dd6 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:54.359166 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-ada261a1-f608-44e9-a7fd-9eb56aeae39b req-91dc90b1-b08b-4323-bfe6-87ae248d9dd6 service nova] Creating event network-vif-deleted:0fe94d1d-11dc-4f32-8bfc-c635d9bc836a for instance 65daa3d7-d3fb-4112-9c68-4dc2158675ea on hv-cinder-86022 Oct 31 15:05:54.364170 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-ada261a1-f608-44e9-a7fd-9eb56aeae39b req-91dc90b1-b08b-4323-bfe6-87ae248d9dd6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032062 Oct 31 15:05:54.364758 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 432/914] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:54.646152 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:54.646774 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:54.653929 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:54.654408 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:54.654845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:54.655530 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:54.656015 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:54.656434 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:54.689152 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:54.689627 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:54.690059 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:54.690497 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lazy-loading 'fault' on Instance uuid 65daa3d7-d3fb-4112-9c68-4dc2158675ea {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:05:54.730375 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ebf0c707045908f3950c7077b3554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3424a823161e49029c454a8818f7bd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:05:54.737891 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0729255f-7584-4d1b-9c96-e1d4a1d3fde7 tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 200 len: 1308 microversion: 2.1 time: 0.095578 Oct 31 15:05:54.738433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 483/915] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:54 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:55.762460 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:55.763162 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] [instance: 65daa3d7-d3fb-4112-9c68-4dc2158675ea] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:05:55.769648 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:55.770127 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:55.770564 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:55.771256 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:55.771735 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:55.772160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:55.785827 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] HTTP exception thrown: Instance 65daa3d7-d3fb-4112-9c68-4dc2158675ea could not be found. Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Request method failure captured: Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea HTTP/1.1 Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-PpiYvqcl5gCSE77s9lMKiL7K34k_tgFmBDk3sa4Z85UYRSeZ09OhB7NcBVMEl_KDeGtXjZKsJZ-7nS-pMoUUOWE63M1nrBuKHhpqXrvrmFC0kjaEr8uPiCM_7snHdVG2GPcdRJpmEOKqb5kaAsKGuMoZXFXnkkHCRfSmU-iVLwjqo Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 3424a823161e49029c454a8818f7bd7f Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1183103503 Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:05:55.787403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3424a823161e49029c454a8818f7bd7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3424a823161e49029c454a8818f7bd7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3424a823161e49029c454a8818f7bd7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3424a823161e49029c454a8818f7bd7f"}]}] Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-VolumesSnapshotTestJSON-1183103503 Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 3424a823161e49029c454a8818f7bd7f Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1183103503 Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-VolumesSnapshotTestJSON-1183103503-project Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: 7b9ebf0c707045908f3950c7077b3554 Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-VolumesSnapshotTestJSON-1183103503-project Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 65daa3d7-d3fb-4112-9c68-4dc2158675ea could not be found. Oct 31 15:05:55.789525 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '65daa3d7-d3fb-4112-9c68-4dc2158675ea'} Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65daa3d7-d3fb-4112-9c68-4dc2158675ea could not be found. Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:05:55.790306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65daa3d7-d3fb-4112-9c68-4dc2158675ea could not be found. Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65daa3d7-d3fb-4112-9c68-4dc2158675ea could not be found. Oct 31 15:05:55.791755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:05:55.793171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] Returning 404 to user: Instance 65daa3d7-d3fb-4112-9c68-4dc2158675ea could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:05:55.793171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-bc1f28d5-93ab-445b-a9fe-a9047dd8653e tempest-VolumesSnapshotTestJSON-1183103503 tempest-VolumesSnapshotTestJSON-1183103503-project] 10.222.0.36 "GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea" status: 404 len: 111 microversion: 2.1 time: 0.031734 Oct 31 15:05:55.796774 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 433/916] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:55 2022] GET /compute/v2.1/servers/65daa3d7-d3fb-4112-9c68-4dc2158675ea => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:06:42.903595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:42.904216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:42.906464 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:42.907123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:42.915516 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:42.916352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:42.916792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:42.917731 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:42.919511 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:42.919511 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:43.104615 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.objects.instance [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lazy-loading 'flavor' on Instance uuid 8a84bc4d-cc6e-455f-a958-b9e62714400b {{(pid=134339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:06:43.189718 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-04617aad-90d6-4bef-bf44-3bbe93423875 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "POST /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b/action" status: 202 len: 0 microversion: 2.1 time: 0.289947 Oct 31 15:06:43.190464 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 484/917] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 15:06:42 2022] POST /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:06:43.201628 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:43.202235 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:43.204652 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=8 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:43.205642 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:43.221997 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:43.222808 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:43.223420 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:43.224401 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:43.225555 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:43.226140 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:43.570305 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:43.578176 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ff5c70db-2120-4cf2-b66d-2e00c3ecec26 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.383002 Oct 31 15:06:43.578728 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 434/918] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:43 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:44.603686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:44.604404 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:44.611187 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:44.611700 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:44.612138 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:44.612851 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:44.613303 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:44.613724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:44.836303 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:44.846103 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6e71bb58-e570-410b-8d47-7df309d1e96e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.247327 Oct 31 15:06:44.846830 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 485/919] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:44 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:45.359834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-354e5399-8ced-4a34-8396-a7df4aecd388 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Action: 'create', calling method: .version_select at 0x7f6c70f02ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-693443362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1QA9k/VuStlh4DQ31sNuFrh06wVAQwtYpN0NxVS9Cn86AMuB8hJp6eKWUXpIg+m94Jt9FnFtNrCIBry2ki3fsxt6ToS2BnxlDiObGjX0La86PNn/kRr0Ng1CyBTJnn3g=="}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:45.377167 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-354e5399-8ced-4a34-8396-a7df4aecd388 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Getting quotas for project 87556dde63c246f78107d7191fe9a177. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:06:45.381373 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-354e5399-8ced-4a34-8396-a7df4aecd388 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Getting quotas for user 0ba4c7a65d8b41e3addbbeba841d79ea and project 87556dde63c246f78107d7191fe9a177. Resources: {'key_pairs'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:06:45.393046 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR oslo.messaging._drivers.impl_rabbit [None req-354e5399-8ced-4a34-8396-a7df4aecd388 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [c24448d0-f63f-42d5-8fae-1337aad3b096] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:06:45.869670 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:45.870283 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:45.876217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:45.876697 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:45.877135 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:45.877824 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:45.878280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:45.878732 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:46.009167 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:46.016841 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-73e277a1-3b21-4e19-9a24-35290a0c6556 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.151327 Oct 31 15:06:46.017387 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 486/920] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:45 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:46.401204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO oslo.messaging._drivers.impl_rabbit [None req-354e5399-8ced-4a34-8396-a7df4aecd388 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [c24448d0-f63f-42d5-8fae-1337aad3b096] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57646. Oct 31 15:06:46.414702 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-354e5399-8ced-4a34-8396-a7df4aecd388 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.058730 Oct 31 15:06:46.415293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 435/921] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 31 15:06:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:46.467131 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1937426638", "imageRef": "6ecc15b5-080d-4266-be28-393f2e468c27", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-693443362", "networks": [{"uuid": "c4a62ce2-68c8-420c-86cd-23c7ed970f6e"}]}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:46.519327 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.network.neutron [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] validate_networks() for [('c4a62ce2-68c8-420c-86cd-23c7ed970f6e', None, None, None, None, None)] {{(pid=134339) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:06:46.903489 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Flavor limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:06:46.904116 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Image limits 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:06:46.904400 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Flavor pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:06:46.904804 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Image pref 0:0:0 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:06:46.905213 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.virt.hardware [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:06:46.914120 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:46.914593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:46.915025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:46.915780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:46.916230 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:46.916648 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:46.933125 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Getting quotas for project 87556dde63c246f78107d7191fe9a177. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:06:46.937035 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.quota [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Getting quotas for user 0ba4c7a65d8b41e3addbbeba841d79ea and project 87556dde63c246f78107d7191fe9a177. Resources: {'cores', 'instances', 'ram'} {{(pid=134339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:06:46.949271 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Going to run 1 instances... {{(pid=134339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:06:46.952259 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ecc15b5-080d-4266-be28-393f2e468c27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:06:46.997753 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [1a77641d-380d-42a1-90d4-c85e67f91b7f] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:06:47.041356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:47.041974 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:47.049051 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:47.049531 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:47.049963 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:47.050646 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:47.051099 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:47.051519 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:47.183296 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:47.191057 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-99fbbe2b-ea05-4390-8d0e-c313672bd23b tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.153668 Oct 31 15:06:47.191634 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 436/922] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:47 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:47.652765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:47.653400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:47.659889 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:47.660228 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:47.660673 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:47.661368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:47.661906 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:47.662767 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:47.688228 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:06:47.764796 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ed6545e7-02ab-45fd-b17e-0cea582e68d4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "DELETE /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 204 len: 0 microversion: 2.1 time: 0.115595 Oct 31 15:06:47.765599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 437/923] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:06:47 2022] DELETE /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:06:47.775467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:47.776195 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:47.781950 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:47.782427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:47.782860 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:47.783543 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:47.784016 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:47.784487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:47.915474 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:47.923966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a513384e-d7ce-496e-bbb6-0c006b072a8f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1577 microversion: 2.1 time: 0.152886 Oct 31 15:06:47.924520 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 438/924] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:47 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:48.005110 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [1a77641d-380d-42a1-90d4-c85e67f91b7f] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57666. Oct 31 15:06:48.009352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cc98c707-84e7-492f-9c97-fdb55cca1531 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.546412 Oct 31 15:06:48.010114 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 487/925] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:06:48.020946 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-412b5094-0d0d-4d21-9cf1-9df06596ba88 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:48.022292 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-412b5094-0d0d-4d21-9cf1-9df06596ba88 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:48.075455 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-412b5094-0d0d-4d21-9cf1-9df06596ba88 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:48.082488 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-412b5094-0d0d-4d21-9cf1-9df06596ba88 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1258 microversion: 2.1 time: 0.065391 Oct 31 15:06:48.083243 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 439/926] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:48 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:48.214871 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:48.215479 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:48.221558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:48.222064 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:48.222494 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:48.223175 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:48.223646 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:48.224064 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:48.364808 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:48.373350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-d165fe73-aca8-404e-a6e7-7a9fa4750ae2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.162556 Oct 31 15:06:48.374195 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 488/927] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:48 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:48.947435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:48.948075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:48.955041 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:48.955516 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:48.955970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:48.956657 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:48.957102 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:48.957549 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:49.093654 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:49.102362 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-db76f5d7-7df7-4ead-8818-c991dca5d901 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1577 microversion: 2.1 time: 0.159753 Oct 31 15:06:49.102926 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 440/928] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:48 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:49.105183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:49.105833 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:49.112804 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:49.113271 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:49.113883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:49.114575 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:49.115025 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:49.115583 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:49.183500 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:49.191076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6838cff7-9523-479a-bd4c-d01caedd4fa0 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1310 microversion: 2.1 time: 0.089630 Oct 31 15:06:49.191692 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 489/929] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:49 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:49.398458 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:49.399071 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:49.414011 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:49.414452 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:49.414891 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:49.415631 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:49.416067 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:49.416673 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:49.634666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:49.642532 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-3f2d9d20-7269-463c-81b8-fefa9d19a8b6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.248344 Oct 31 15:06:49.643106 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 441/930] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:49 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:50.126443 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:50.127923 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:50.136493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:50.137218 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:50.137875 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:50.138797 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:50.139455 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:50.140123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:50.215872 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:50.217151 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:50.234275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:50.235021 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:50.235702 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:50.236611 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:50.237264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:50.242158 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:50.325923 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:50.337163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-dbcdbc41-8ed7-494b-8315-009ab1b2faed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1577 microversion: 2.1 time: 0.215187 Oct 31 15:06:50.340485 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 490/931] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:50 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1577 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:50.367137 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:50.376406 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8a333c6d-ec4f-47e0-b5d8-2c6ab2d2ac92 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1316 microversion: 2.1 time: 0.165122 Oct 31 15:06:50.388791 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 442/932] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:50 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:50.677535 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:50.679342 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:50.695367 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:50.696301 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:50.698961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:50.704407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:50.705071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:50.705401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:50.922485 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:50.939959 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8ac45f75-05d1-4618-b530-1f48fcf489c8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.269230 Oct 31 15:06:50.940917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 491/933] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:50 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:51.364372 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:51.366683 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:51.373896 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:51.380331 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:51.381972 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:51.384672 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:51.385385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:51.386215 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:51.403969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:51.405321 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:51.442270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:51.452212 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:51.452752 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:51.453517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:51.453991 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:51.454440 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:51.530934 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:51.546884 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-830ec52c-1f44-4a9b-94f5-1526a75c5b0d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1510 microversion: 2.1 time: 0.182790 Oct 31 15:06:51.548451 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 443/934] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:51 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:51.596752 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-9761de74-5323-469b-8ee7-b225b0d6d24d req-613879b6-df88-4f58-af79-9abac2c29339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95baeb64-0d66-4688-8450-ce141151856f", "name": "network-vif-deleted", "tag": "110ccfc6-0f74-4a58-87e5-897a238a6b52"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:51.609989 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-9761de74-5323-469b-8ee7-b225b0d6d24d req-613879b6-df88-4f58-af79-9abac2c29339 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:51.610841 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-9761de74-5323-469b-8ee7-b225b0d6d24d req-613879b6-df88-4f58-af79-9abac2c29339 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:51.611683 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-9761de74-5323-469b-8ee7-b225b0d6d24d req-613879b6-df88-4f58-af79-9abac2c29339 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:51.628755 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-9761de74-5323-469b-8ee7-b225b0d6d24d req-613879b6-df88-4f58-af79-9abac2c29339 service nova] Creating event network-vif-deleted:110ccfc6-0f74-4a58-87e5-897a238a6b52 for instance 95baeb64-0d66-4688-8450-ce141151856f on hv-cinder-86022 Oct 31 15:06:51.635372 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-9761de74-5323-469b-8ee7-b225b0d6d24d req-613879b6-df88-4f58-af79-9abac2c29339 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044501 Oct 31 15:06:51.641123 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 444/935] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:06:51.745094 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:51.754410 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-4462bb90-bf23-4e0f-827c-2e808c607616 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.354766 Oct 31 15:06:51.760399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 492/936] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:51 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:51.967155 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:51.968266 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:51.975282 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:51.976211 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:51.976641 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:51.977433 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:51.978047 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:51.978631 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:52.131707 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:52.140819 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a0cd0f17-829f-4ebe-9e81-0328055a1b2e tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.178890 Oct 31 15:06:52.151171 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 445/937] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:51 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:52.574765 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:52.575473 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:52.582531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:52.583231 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:52.584538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:52.585512 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:52.586169 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:52.586789 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:52.654782 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:52.663487 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-140ae85b-1033-4619-82d6-db89f8c27d34 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1510 microversion: 2.1 time: 0.092510 Oct 31 15:06:52.664699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 493/938] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:52 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:52.778927 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:52.779651 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:52.790527 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:52.791277 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:52.792062 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:52.793084 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:52.793762 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:52.794470 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:52.969840 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:52.978655 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-8c147ee3-5a1d-468c-8ccb-9274aafa0487 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.204013 Oct 31 15:06:52.979262 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 446/939] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:52 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:53.168247 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:53.168987 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:53.175448 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:53.175997 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:53.176434 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:53.177134 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:53.177611 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:53.178031 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:53.329250 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:53.337416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-81f5beba-e540-447a-8097-75dd8413b504 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.173575 Oct 31 15:06:53.338189 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 494/940] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:53 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:53.687787 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:53.688427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:53.696317 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:53.696838 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:53.697276 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:53.697986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:53.698439 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:53.698863 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:53.766816 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:53.775860 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7addeae5-001f-4377-b263-89c7a880edad tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1510 microversion: 2.1 time: 0.091858 Oct 31 15:06:53.776444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 447/941] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:53 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1510 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:54.003157 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:54.003966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:54.011280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:54.011806 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:54.012236 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:54.013267 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:54.013920 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:54.014602 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:54.158554 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:54.168906 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e03d78dc-7eb4-4c3e-8ab3-adefaccd10ce tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.170022 Oct 31 15:06:54.169575 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 495/942] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:53 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:54.361790 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:54.362528 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:54.369968 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:54.370453 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:54.370893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:54.371595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:54.374383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:54.374383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:54.525318 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:54.534029 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a6f7dcda-ef3a-4120-9b38-b147a2293ade tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.176101 Oct 31 15:06:54.534606 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 448/943] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:54 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:54.800398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:54.801019 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:54.808178 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:54.808669 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:54.809113 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:54.809809 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:54.810262 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:54.810686 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:54.878904 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:54.887819 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8afe7740-1e5e-45d2-9851-312f8fe17df2 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1510 microversion: 2.1 time: 0.091225 Oct 31 15:06:54.888551 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 496/944] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:54 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1510 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:55.196757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:55.197554 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:55.203718 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:55.204209 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:55.204645 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:55.205343 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:55.205795 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:55.206216 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:55.343473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:55.351743 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1bd80522-cb81-497e-a2d6-f08408d9037a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.159696 Oct 31 15:06:55.352324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 449/945] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:55 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:55.558660 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:55.560090 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:55.568407 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:55.568898 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:55.569158 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:55.570003 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:55.570348 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:55.570766 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:55.719703 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:55.728079 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-20da2492-c2da-443c-acbb-3cc3fa3f8bb6 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.173255 Oct 31 15:06:55.728578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 497/946] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:55 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:55.912107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:55.912936 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:55.919417 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:55.920619 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:55.921594 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:55.921825 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:55.922537 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:55.922797 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:55.997773 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:56.008078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-61dbe151-36d6-4768-b378-8dcdbfbc00ce tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1510 microversion: 2.1 time: 0.099775 Oct 31 15:06:56.008835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 450/947] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:55 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1510 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:56.374938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:56.375457 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:56.382518 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:56.383029 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:56.383490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:56.384274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:56.384726 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:56.385163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:56.523079 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:56.531806 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-182b429f-1c28-4444-8c9a-5d2e5075c4ee tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.161301 Oct 31 15:06:56.535630 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 498/948] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:56 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:56.751568 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:56.752228 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:56.758731 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:56.759214 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:56.759677 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:56.760473 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:56.760866 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:56.761291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:56.782879 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:56.916153 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:56.925058 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ab16a6b1-24c6-475a-8b57-6a29addfe9b2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.177316 Oct 31 15:06:56.925835 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 451/949] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:56 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:57.032804 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:57.034487 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:57.038226 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:57.038836 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=6 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:57.045454 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.045960 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.046381 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:57.047252 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.047743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.048372 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:57.065743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:57.117422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:57.125274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1ca2ca51-9da8-4a7a-94e1-8587b377dd58 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1510 microversion: 2.1 time: 0.096632 Oct 31 15:06:57.126060 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 499/950] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:57 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:57.557073 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:57.557690 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:57.563662 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.564144 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.564573 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:57.565281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.565710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.566132 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:57.706885 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:57.715325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d509a2d3-2f0a-4e04-a003-552851c284c4 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.163123 Oct 31 15:06:57.715927 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 452/951] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:57 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:57.951345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:57.952286 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:57.958823 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.959625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.959804 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:57.960508 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:57.960962 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:57.961383 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.104627 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:58.112751 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-31374912-9595-4127-afbd-d591ae8959f8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.165663 Oct 31 15:06:58.113312 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 500/952] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:57 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:58.149982 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:58.150617 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:58.153013 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=6 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:58.158750 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.159247 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.159714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.160428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.160886 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.161312 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.229988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:58.238442 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-de3355bd-9b8d-4190-b407-5851ba885171 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1510 microversion: 2.1 time: 0.093664 Oct 31 15:06:58.239025 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 453/953] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:58 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:58.738080 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:58.738705 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:58.745882 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.746372 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.746830 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.747506 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:58.747997 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:58.748422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:58.882783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:58.890668 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-88c5ad09-319f-4491-9eeb-d080dc0d44e5 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.156490 Oct 31 15:06:58.891237 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 501/954] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:58 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:59.136859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:59.137384 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:59.143294 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:59.143811 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:59.144245 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:59.144930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:59.145379 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:59.145799 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:59.269685 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:59.270290 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:59.274680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:59.276796 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:59.277287 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:59.277726 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:59.278429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:59.278885 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:59.279311 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:59.282539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-86c7aa16-55f5-4da0-bab1-e36fb43979ac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.149640 Oct 31 15:06:59.283265 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 454/955] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:59 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:59.346403 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:06:59.354339 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0c195c07-702e-4778-bf7a-a0eeb9b6ab14 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 200 len: 1510 microversion: 2.1 time: 0.088544 Oct 31 15:06:59.354998 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 502/956] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:59 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:59.914251 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:59.914910 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:06:59.922529 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:59.923000 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:59.923534 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:06:59.924680 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:06:59.925219 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:06:59.925791 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:00.252994 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:00.260696 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b52d1b66-6d63-495e-93be-b2e401634e24 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.350703 Oct 31 15:07:00.261255 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 455/957] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:06:59 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:00.306600 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:00.307229 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:00.313783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:00.314271 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:00.314713 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:00.315409 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:00.315893 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:00.316320 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:00.378453 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:00.379059 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:00.385964 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:00.386463 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:00.386902 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:00.387831 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:00.388296 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:00.388725 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:00.405113 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] HTTP exception thrown: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Request method failure captured: Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f HTTP/1.1 Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-PWxwYgK4wdMZ-hoChxqRmCVkGYodt-e3PICfWomKUjtDNs2pjFcOuRUmMy0U5v0erf3cRvPQRsxQfbaM-T8a7OCUTuN-DaUDL9sWMiazxjkCT-n4hB6efD5gHUwXLayxltd-Miyz_-8uiMNAsywEY56bUTmiP4IxoVziZUKboKYks Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:07:00.406775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7f5a9331dd54d9e8b5033234cb1077a"}]}] Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-TestVolumeBootPattern-530201108 Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: f0b358738b5a46d8bc1db1da68040c8f Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:07:00.408299 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '95baeb64-0d66-4688-8450-ce141151856f'} Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:07:00.409159 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:07:00.412966 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:07:00.414189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Returning 404 to user: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:07:00.414189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c73eb733-882d-45c0-b9b3-e9c19e5689ec tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 404 len: 111 microversion: 2.1 time: 0.034374 Oct 31 15:07:00.414189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 456/958] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:00 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:07:00.458505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:00.467896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-f74d7dbd-74c8-44cd-a48f-a53afdff2bac tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.165390 Oct 31 15:07:00.468511 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 503/959] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:00 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:00.522800 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1214327636", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2106455873", "security_groups": [{"name": "tempest-secgroup-smoke-825469118"}], "block_device_mapping_v2": [{"uuid": "87feb45a-a547-4f7a-baff-592ae7194109", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3aa20268-e1a0-450c-8a2f-a6e3730c1b1e"}]}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:00.608288 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-99b5e0be-b43f-4c1d-99c3-600b86c14a71 req-a475dd92-3448-4c46-a684-41f3fb92384f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cc9303-4a2f-44f1-84cf-b21cbfc2281e", "tag": "2a20279b-5dcc-41a2-ac81-47e5c15b62b8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:00.617995 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-99b5e0be-b43f-4c1d-99c3-600b86c14a71 req-a475dd92-3448-4c46-a684-41f3fb92384f service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:00.618474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-99b5e0be-b43f-4c1d-99c3-600b86c14a71 req-a475dd92-3448-4c46-a684-41f3fb92384f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:00.618907 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-99b5e0be-b43f-4c1d-99c3-600b86c14a71 req-a475dd92-3448-4c46-a684-41f3fb92384f service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:00.629608 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-99b5e0be-b43f-4c1d-99c3-600b86c14a71 req-a475dd92-3448-4c46-a684-41f3fb92384f service nova] Creating event network-changed:2a20279b-5dcc-41a2-ac81-47e5c15b62b8 for instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e on hv-cinder-86022 Oct 31 15:07:00.634545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-99b5e0be-b43f-4c1d-99c3-600b86c14a71 req-a475dd92-3448-4c46-a684-41f3fb92384f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030257 Oct 31 15:07:00.635134 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 504/960] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:07:00.796240 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] validate_networks() for [('3aa20268-e1a0-450c-8a2f-a6e3730c1b1e', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:07:01.284155 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:01.284859 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:01.291701 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:01.292193 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:01.292630 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:01.293326 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:01.293782 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:01.294211 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:01.400686 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:07:01.401165 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:07:01.401566 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:07:01.401973 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:07:01.402383 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:07:01.411189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:01.411998 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:01.412275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:01.413156 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:01.413611 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:01.414038 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:01.426462 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:01.431651 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Getting quotas for project d7f5a9331dd54d9e8b5033234cb1077a. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:07:01.434919 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ee90b233-7477-4de4-bbc4-5c4fa5a85a75 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.154828 Oct 31 15:07:01.435498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 505/961] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:01 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:01.435656 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Getting quotas for user f0b358738b5a46d8bc1db1da68040c8f and project d7f5a9331dd54d9e8b5033234cb1077a. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:07:01.491996 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:01.492638 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:01.492897 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:07:01.495101 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87feb45a-a547-4f7a-baff-592ae7194109',volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:07:01.498520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:01.499284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:01.499757 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:01.500474 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:01.500928 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:01.501350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:01.627124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5318cf5d-6d13-44a3-a3a5-17389ea34047 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.108203 Oct 31 15:07:01.628427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 457/962] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:07:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:07:01.639225 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-96f19379-630c-49f9-a886-e55cb3470904 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:01.640108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-96f19379-630c-49f9-a886-e55cb3470904 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:01.640435 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:01.649041 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-beb1f1c9-2cb8-405e-bd7b-1a5d2c34f1c0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.160909 Oct 31 15:07:01.649706 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 506/963] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:01 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:01.706196 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-96f19379-630c-49f9-a886-e55cb3470904 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:01.713710 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-96f19379-630c-49f9-a886-e55cb3470904 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1095 microversion: 2.1 time: 0.078622 Oct 31 15:07:01.714276 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 458/964] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:01 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:02.458174 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:02.458866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:02.465305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:02.465798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:02.466238 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:02.466946 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:02.467401 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:02.467854 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:02.599684 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:02.607798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6405b828-fc44-40a7-9ddc-1ce65c86b4f2 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.153433 Oct 31 15:07:02.608572 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 507/965] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:02 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:02.675662 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:02.676402 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:02.683169 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:02.683765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:02.684262 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:02.685035 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:02.685554 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:02.686039 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:02.736674 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:02.737287 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:02.739658 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:07:02.739946 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Mon Oct 31 15:07:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 (ip 10.222.0.36) !!! Oct 31 15:07:02.746150 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:02.746641 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:02.747960 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:02.747960 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:02.748242 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:02.748665 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:02.814104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:02.823054 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:02.823209 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-18c9be4e-0003-4c38-876a-60fce0c4bf4b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1193 microversion: 2.1 time: 0.090378 Oct 31 15:07:02.823790 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 508/966] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:02 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:02.831022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-1b48b45a-dd80-414d-8621-5b6c54b60731 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.159457 Oct 31 15:07:02.831597 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 459/967] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:02 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:03.632300 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:03.632923 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:03.643341 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:03.644326 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:03.644845 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:03.645668 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:03.647171 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:03.648520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:03.802277 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:03.810256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-31acf501-a150-421a-9d12-edf7d20e5c01 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.183990 Oct 31 15:07:03.810837 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 509/968] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:03 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:03.846425 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:03.847027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:03.854119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:03.854597 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:03.854969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:03.855106 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:03.855617 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:03.855745 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:03.856152 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:03.856572 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:03.861666 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:03.862065 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:03.862498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:03.863197 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:03.863674 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:03.864131 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:03.924523 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:03.935582 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6f2ae0f1-356b-49c5-95e0-24014a818228 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1211 microversion: 2.1 time: 0.092591 Oct 31 15:07:03.936859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 460/969] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:03 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:04.025256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:04.033248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-98e43201-cb93-4be6-b779-f104a3c80baf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1568 microversion: 2.1 time: 0.182101 Oct 31 15:07:04.033865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 510/970] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:03 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:04.059105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:04.059768 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:04.065978 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.066791 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.067439 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:04.068730 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.069404 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.070044 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:04.106069 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134338) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 15:07:04.181609 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d9ce84d6-a7b7-442f-9b66-a14d3953afee tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "POST /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b/action" status: 202 len: 0 microversion: 2.1 time: 0.126568 Oct 31 15:07:04.182324 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 461/971] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 15:07:04 2022] POST /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:07:04.190677 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:04.191303 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:04.199177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.199701 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.200358 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:04.201239 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.201702 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.202310 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:04.390595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:04.400173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0c8e9370-c71e-485d-8444-a5565d406ba0 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1516 microversion: 2.1 time: 0.213309 Oct 31 15:07:04.401138 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 511/972] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:04 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:04.834470 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:04.835078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:04.843652 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.844397 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.845165 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:04.847356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.848280 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.848796 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:04.960743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:04.961437 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:04.972285 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.972780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.973213 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:04.978005 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:04.978725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:04.979397 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:05.065021 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:05.077000 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-733ea0ce-2819-4e55-a9df-eda187babea9 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.247065 Oct 31 15:07:05.077829 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 462/973] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:04 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:05.144376 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:05.152692 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-42e39757-2d5a-491f-aed2-16ce490d08b9 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.196719 Oct 31 15:07:05.153264 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 512/974] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:04 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:05.425082 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:05.425736 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:05.429321 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:05.435969 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:05.436464 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:05.436905 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:05.437665 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:05.438107 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:05.440244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:05.668438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:05.676746 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ece0af47-1411-4390-b75d-c52e5934c2c5 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1574 microversion: 2.1 time: 0.256128 Oct 31 15:07:05.685205 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 463/975] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:05 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:05.742392 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-dca28773-00cf-4811-8e8c-0e251bc47523 req-211f71f1-e0f8-444d-af8f-d4d12246b5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8fb6758-3ce0-4d41-9f6c-60d461c90d66", "tag": "01c6e9f9-8dac-4996-b9c6-53898d243ad8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:05.751852 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-dca28773-00cf-4811-8e8c-0e251bc47523 req-211f71f1-e0f8-444d-af8f-d4d12246b5fe service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:05.752359 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-dca28773-00cf-4811-8e8c-0e251bc47523 req-211f71f1-e0f8-444d-af8f-d4d12246b5fe service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:05.752795 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-dca28773-00cf-4811-8e8c-0e251bc47523 req-211f71f1-e0f8-444d-af8f-d4d12246b5fe service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:05.764567 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-dca28773-00cf-4811-8e8c-0e251bc47523 req-211f71f1-e0f8-444d-af8f-d4d12246b5fe service nova] Creating event network-changed:01c6e9f9-8dac-4996-b9c6-53898d243ad8 for instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 on hv-cinder-86022 Oct 31 15:07:05.769616 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-dca28773-00cf-4811-8e8c-0e251bc47523 req-211f71f1-e0f8-444d-af8f-d4d12246b5fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031421 Oct 31 15:07:05.770201 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 513/976] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:06.102813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:06.103527 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:06.109986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:06.110466 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:06.110899 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:06.111620 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:06.112074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:06.112527 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:06.176416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:06.177121 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:06.183938 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:06.184432 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:06.184870 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:06.185558 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:06.186010 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:06.186433 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:06.332326 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:06.340333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e4727bfe-37eb-4ecd-b6f4-07329e11b5d8 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.168538 Oct 31 15:07:06.341248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 514/977] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:06 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:06.404623 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:06.413483 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-87d65f14-4445-4193-8993-cf5631fae077 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.315170 Oct 31 15:07:06.414057 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 464/978] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:06 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:06.700749 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:06.701422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:06.707425 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:06.707945 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:06.708380 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:06.710088 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:06.710546 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:06.710971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:06.853136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:06.860950 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5999c72e-ca6f-4c99-befc-5ca9ab094757 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1574 microversion: 2.1 time: 0.164085 Oct 31 15:07:06.861519 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 515/979] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:06 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:07.117263 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-c28419fa-d4cd-445d-be77-3fe2851f948c req-ea805e90-8f83-44cd-866f-ba9b4bb9ae86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cc9303-4a2f-44f1-84cf-b21cbfc2281e", "name": "network-vif-plugged", "status": "completed", "tag": "2a20279b-5dcc-41a2-ac81-47e5c15b62b8"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:07.127706 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-c28419fa-d4cd-445d-be77-3fe2851f948c req-ea805e90-8f83-44cd-866f-ba9b4bb9ae86 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:07.128181 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-c28419fa-d4cd-445d-be77-3fe2851f948c req-ea805e90-8f83-44cd-866f-ba9b4bb9ae86 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:07.128606 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-c28419fa-d4cd-445d-be77-3fe2851f948c req-ea805e90-8f83-44cd-866f-ba9b4bb9ae86 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:07.140810 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-c28419fa-d4cd-445d-be77-3fe2851f948c req-ea805e90-8f83-44cd-866f-ba9b4bb9ae86 service nova] Creating event network-vif-plugged:2a20279b-5dcc-41a2-ac81-47e5c15b62b8 for instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e on hv-cinder-86022 Oct 31 15:07:07.146830 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-c28419fa-d4cd-445d-be77-3fe2851f948c req-ea805e90-8f83-44cd-866f-ba9b4bb9ae86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032754 Oct 31 15:07:07.147602 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 465/980] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:07:07.364067 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:07.365248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:07.371752 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:07.372231 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:07.372656 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:07.373344 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:07.373789 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:07.374206 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:07.437590 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:07.438294 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:07.445981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:07.446464 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:07.446900 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:07.447626 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:07.448085 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:07.448511 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:07.511314 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:07.519095 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7811aa92-ab29-4ad8-b644-e985480d42ed tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.158936 Oct 31 15:07:07.519894 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 516/981] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:07 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:07.580773 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:07.588834 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-11b794f6-3b6a-4f81-bff1-58da4c367ea6 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1358 microversion: 2.1 time: 0.155407 Oct 31 15:07:07.589334 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 466/982] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:07 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:07.884820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:07.885386 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:07.891260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:07.891783 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:07.892219 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:07.892896 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:07.893343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:07.893762 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:07.897732 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=100 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:08.021101 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:08.028934 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1cc6e864-ed42-438b-a9b3-2cfe4f272ecf tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1574 microversion: 2.1 time: 0.148082 Oct 31 15:07:08.029494 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 517/983] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:07 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:08.542487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.543109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.549623 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.550109 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.550547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.551240 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.551736 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.552162 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.610791 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.611414 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.618948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.619436 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.619898 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.620600 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.621057 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.621484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.688802 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:08.698899 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-754b9f62-b188-4386-8417-5a2b7b682d8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.159991 Oct 31 15:07:08.699981 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 467/984] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:08 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:08.764082 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:08.771823 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-8cda265c-7935-4a50-8b6c-4fd3a784dea7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1548 microversion: 2.1 time: 0.164900 Oct 31 15:07:08.772377 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 518/985] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:08 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:08.794621 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.795163 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:08.801028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.801502 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.801933 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.803245 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.803913 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.804333 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.929398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:08.937433 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-45221cb3-ff81-4d84-9cf7-745e6117b1e3 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1548 microversion: 2.1 time: 0.146644 Oct 31 15:07:08.937993 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 468/986] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:08 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:08.960951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:08.966007 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:08.966777 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Searching by: {'deleted': False, 'project_id': '87556dde63c246f78107d7191fe9a177'} {{(pid=134339) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:07:08.973422 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.973899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.976473 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:08.977222 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:08.977687 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:08.978121 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:09.052150 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:09.052715 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:09.058596 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:09.059104 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:09.059534 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:09.060243 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:09.060690 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:09.061108 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:09.070076 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.multi_cell_list [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134339) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:07:09.168268 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cd4ee4cc-7a3c-40b7-9182-0d51b7f0ebe7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212272 Oct 31 15:07:09.168864 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 519/987] 10.222.0.36 () {58 vars in 1125 bytes} [Mon Oct 31 15:07:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:09.173245 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-da3e90b9-0291-4cd9-834d-6eeb49b427b2 req-7924c7a4-14b5-43aa-b105-af4ad3f07d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a84bc4d-cc6e-455f-a958-b9e62714400b", "name": "network-vif-unplugged", "status": "completed", "tag": "14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:09.183285 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-da3e90b9-0291-4cd9-834d-6eeb49b427b2 req-7924c7a4-14b5-43aa-b105-af4ad3f07d10 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:09.183790 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-da3e90b9-0291-4cd9-834d-6eeb49b427b2 req-7924c7a4-14b5-43aa-b105-af4ad3f07d10 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:09.184216 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-da3e90b9-0291-4cd9-834d-6eeb49b427b2 req-7924c7a4-14b5-43aa-b105-af4ad3f07d10 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:09.190987 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:09.195625 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-da3e90b9-0291-4cd9-834d-6eeb49b427b2 req-7924c7a4-14b5-43aa-b105-af4ad3f07d10 service nova] Creating event network-vif-unplugged:14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae for instance 8a84bc4d-cc6e-455f-a958-b9e62714400b on hv-cinder-86022 Oct 31 15:07:09.199802 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-cf31688b-40d4-4408-a458-b07c65eea8d2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1574 microversion: 2.1 time: 0.151591 Oct 31 15:07:09.204003 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 469/988] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:09 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:09.204573 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-da3e90b9-0291-4cd9-834d-6eeb49b427b2 req-7924c7a4-14b5-43aa-b105-af4ad3f07d10 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030673 Oct 31 15:07:09.204573 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 520/989] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:09.205348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:09.205959 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:09.211730 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:09.212213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:09.212650 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:09.213413 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:09.213874 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:09.214300 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:09.218387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:09.346143 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:09.354347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-cec99f6d-cbf6-485d-acde-49dfbba1fa46 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1548 microversion: 2.1 time: 0.153035 Oct 31 15:07:09.354904 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 470/990] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:09 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:09.723209 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:09.723927 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:09.730658 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:09.731138 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:09.731593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:09.732291 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:09.732739 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:09.733161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:09.864874 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:09.872603 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e8e4ad6b-ca4d-4191-8d23-f85359ecbc02 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.154200 Oct 31 15:07:09.873161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 521/991] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:09 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:10.222999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:10.223642 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:10.230763 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:10.231246 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:10.231711 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:10.232405 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:10.232856 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:10.233281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:10.362591 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:10.370462 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-9754089f-8191-4e1d-a2e2-0a927ffbecb7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1574 microversion: 2.1 time: 0.151374 Oct 31 15:07:10.371024 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 471/992] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:10 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:10.895698 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-62ea7d3e-ae01-45b7-a821-d6a25c8da465 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b57221e3-6361-4a22-a34d-e92193d757ac"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:10.896866 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:10.897519 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:10.898418 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-62ea7d3e-ae01-45b7-a821-d6a25c8da465 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:10.903487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:10.904004 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:10.904433 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:10.904931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-62ea7d3e-ae01-45b7-a821-d6a25c8da465 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:10.905119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:10.905538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-62ea7d3e-ae01-45b7-a821-d6a25c8da465 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:10.905649 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:10.905970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:10.906154 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-62ea7d3e-ae01-45b7-a821-d6a25c8da465 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:10.906939 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-62ea7d3e-ae01-45b7-a821-d6a25c8da465 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:10.907467 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-62ea7d3e-ae01-45b7-a821-d6a25c8da465 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:10.907978 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-62ea7d3e-ae01-45b7-a821-d6a25c8da465 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:11.049218 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:11.057610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-22e6b8ee-415f-4107-98b3-b9c591b7e1f4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.164502 Oct 31 15:07:11.058205 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 472/993] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:10 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:11.320437 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-62ea7d3e-ae01-45b7-a821-d6a25c8da465 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "POST /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428520 Oct 31 15:07:11.321041 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 522/994] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 31 15:07:10 2022] POST /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:11.393430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:11.393936 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:11.401794 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:11.402306 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:11.402741 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:11.403514 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:11.403898 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:11.404408 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:11.420474 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:11.539768 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:11.547502 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-cb4d26da-db79-443e-9766-b5b4cc78abf8 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1574 microversion: 2.1 time: 0.157967 Oct 31 15:07:11.548101 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 473/995] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:11 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:12.082124 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:12.082825 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:12.090537 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:12.091022 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:12.091456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:12.092177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:12.092724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:12.093149 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:12.221616 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:12.229796 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-90b0b4bb-2d1a-41d7-b58a-2b74a0e26b04 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.151957 Oct 31 15:07:12.230357 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 523/996] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:12 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:12.571117 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:12.571749 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:12.573595 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=8 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:12.579348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:12.579859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:12.580293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:12.580978 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:12.581428 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:12.581845 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:12.712380 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:12.720182 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-2d51aa5b-e0e5-4f7b-8c99-e3b7de813ec7 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1574 microversion: 2.1 time: 0.153260 Oct 31 15:07:12.720748 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 474/997] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:12 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:13.252931 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:13.253551 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:13.256149 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:13.261363 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:13.261849 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:13.262289 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:13.262984 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:13.263437 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:13.263894 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:13.403356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:13.412350 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c56f0947-60b7-4f0c-991c-316da0f70fd1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.162562 Oct 31 15:07:13.413058 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 524/998] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:13 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:13.744461 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:13.745074 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:13.751691 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:13.752206 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:13.752635 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:13.753356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:13.753805 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:13.754252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:13.883439 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:13.891124 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a996e132-9017-43ab-9b51-8d1f153bc74f tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1574 microversion: 2.1 time: 0.150487 Oct 31 15:07:13.891708 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 475/999] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:13 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:14.435523 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:14.436173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:14.443104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:14.444195 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:14.444699 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:14.445398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:14.445854 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:14.446279 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:14.583941 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:14.595531 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ebf509b1-4f7f-4327-9afb-8f87b7b56910 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.164439 Oct 31 15:07:14.596111 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 525/1000] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:14 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:14.915115 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:14.915875 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:14.922283 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:14.922926 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:14.923356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:14.924071 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:14.924517 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:14.924929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:15.056956 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:15.064745 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0afc795b-088e-4704-af7c-b17fc988e763 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1561 microversion: 2.1 time: 0.154374 Oct 31 15:07:15.065683 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 476/1001] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:14 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:15.618210 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:15.618822 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:15.625375 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:15.625849 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:15.626276 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:15.626971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:15.627398 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:15.627856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:15.768563 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:15.777516 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-2e50bdb5-4b9d-4458-9cb7-6aa31852bd6b tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.163063 Oct 31 15:07:15.778077 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 526/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:15 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:16.800079 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:16.800648 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:16.807091 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:16.807598 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:16.808032 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:16.808724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:16.809176 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:16.809596 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:16.939778 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:16.948032 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d3cc32f5-52f8-46db-a77b-70a104509878 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.151869 Oct 31 15:07:16.948593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 477/1003] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:16 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:17.138161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-1d7e286f-1fa1-4815-b966-ad729da3508f req-a9334860-b3cc-4be5-ac84-4320f7989172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a84bc4d-cc6e-455f-a958-b9e62714400b", "name": "network-vif-plugged", "status": "completed", "tag": "14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:17.148614 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-1d7e286f-1fa1-4815-b966-ad729da3508f req-a9334860-b3cc-4be5-ac84-4320f7989172 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:17.149084 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-1d7e286f-1fa1-4815-b966-ad729da3508f req-a9334860-b3cc-4be5-ac84-4320f7989172 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:17.149651 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-1d7e286f-1fa1-4815-b966-ad729da3508f req-a9334860-b3cc-4be5-ac84-4320f7989172 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:17.161032 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-1d7e286f-1fa1-4815-b966-ad729da3508f req-a9334860-b3cc-4be5-ac84-4320f7989172 service nova] Creating event network-vif-plugged:14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae for instance 8a84bc4d-cc6e-455f-a958-b9e62714400b on hv-cinder-86022 Oct 31 15:07:17.167798 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-1d7e286f-1fa1-4815-b966-ad729da3508f req-a9334860-b3cc-4be5-ac84-4320f7989172 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033189 Oct 31 15:07:17.168399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 527/1004] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:17.860146 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:17.860760 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:17.867333 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:17.867859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:17.868293 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:17.868978 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:17.869426 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:17.869846 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:17.971927 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:17.972626 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:17.979336 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:17.979855 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:17.980297 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:17.980993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:17.981443 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:17.981866 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:18.000483 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:18.008893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b7becb3d-2c9a-4a60-8a1a-28861595e050 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1594 microversion: 2.1 time: 0.152530 Oct 31 15:07:18.009461 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 478/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:17 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:18.114036 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:18.121824 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c6834e8f-fe78-477f-b963-9378c98e1462 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.154166 Oct 31 15:07:18.122395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 528/1006] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:17 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:19.144682 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:19.145292 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:19.157345 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:19.158022 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:19.158540 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:19.159334 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:19.159906 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:19.160403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:19.184446 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-af44c897-b003-423f-b88b-3f230759b374 req-35ff4edf-166a-4bfc-b35b-1064f96c5331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fb6758-3ce0-4d41-9f6c-60d461c90d66", "name": "network-vif-plugged", "status": "completed", "tag": "01c6e9f9-8dac-4996-b9c6-53898d243ad8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:19.190588 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:19.198074 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-af44c897-b003-423f-b88b-3f230759b374 req-35ff4edf-166a-4bfc-b35b-1064f96c5331 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:19.198557 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-af44c897-b003-423f-b88b-3f230759b374 req-35ff4edf-166a-4bfc-b35b-1064f96c5331 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:19.198994 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-af44c897-b003-423f-b88b-3f230759b374 req-35ff4edf-166a-4bfc-b35b-1064f96c5331 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:19.211322 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-af44c897-b003-423f-b88b-3f230759b374 req-35ff4edf-166a-4bfc-b35b-1064f96c5331 service nova] Creating event network-vif-plugged:01c6e9f9-8dac-4996-b9c6-53898d243ad8 for instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 on hv-cinder-86022 Oct 31 15:07:19.216249 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-af44c897-b003-423f-b88b-3f230759b374 req-35ff4edf-166a-4bfc-b35b-1064f96c5331 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035763 Oct 31 15:07:19.216861 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 529/1007] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:07:19.648604 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:19.656684 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6a170caa-4ded-4383-b64a-c3aa46994abf tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.515836 Oct 31 15:07:19.657259 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 479/1008] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:19 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:20.062985 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-b7c5db0e-87ad-40fe-b2ab-23b93bca567f req-3fdb8271-d32e-454d-a5ee-07c967db5a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cc9303-4a2f-44f1-84cf-b21cbfc2281e", "tag": "2a20279b-5dcc-41a2-ac81-47e5c15b62b8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:20.075788 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b7c5db0e-87ad-40fe-b2ab-23b93bca567f req-3fdb8271-d32e-454d-a5ee-07c967db5a9d service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:20.076509 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b7c5db0e-87ad-40fe-b2ab-23b93bca567f req-3fdb8271-d32e-454d-a5ee-07c967db5a9d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:20.077270 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b7c5db0e-87ad-40fe-b2ab-23b93bca567f req-3fdb8271-d32e-454d-a5ee-07c967db5a9d service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:20.089390 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-b7c5db0e-87ad-40fe-b2ab-23b93bca567f req-3fdb8271-d32e-454d-a5ee-07c967db5a9d service nova] Creating event network-changed:2a20279b-5dcc-41a2-ac81-47e5c15b62b8 for instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e on hv-cinder-86022 Oct 31 15:07:20.095439 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-b7c5db0e-87ad-40fe-b2ab-23b93bca567f req-3fdb8271-d32e-454d-a5ee-07c967db5a9d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107900 Oct 31 15:07:20.096494 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 530/1009] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:07:20.681401 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:20.682028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:20.689088 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:20.689577 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:20.690192 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:20.691066 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:20.691517 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:20.692091 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:20.893668 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:20.903906 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d8cba149-6a5c-4b47-9474-86c1766daf35 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1266 microversion: 2.1 time: 0.227361 Oct 31 15:07:20.920237 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 480/1010] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:20 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:20.992801 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-742568136"}} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:20.993523 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:21.000385 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:21.000927 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:21.001490 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:21.002204 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:21.002660 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:21.003080 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:21.144163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.network.security_group_api [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Adding security group 4358da55-f39b-4285-a328-d4eb6dcf9d26 to port 2a20279b-5dcc-41a2-ac81-47e5c15b62b8 Oct 31 15:07:21.524947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cb63364e-a7a4-4c0e-a95b-d43eb87b6597 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "POST /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/action" status: 202 len: 0 microversion: 2.1 time: 0.542227 Oct 31 15:07:21.524947 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 531/1011] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 15:07:20 2022] POST /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:07:21.529947 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:21.533429 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:21.543203 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:21.543940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:21.544368 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:21.549581 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-a83a971f-620e-43f1-9df8-dfbd9f420a88 req-7b0af44e-7f1f-40a6-ac4e-ebb52493e143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cc9303-4a2f-44f1-84cf-b21cbfc2281e", "tag": "2a20279b-5dcc-41a2-ac81-47e5c15b62b8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:21.555870 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:21.558959 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:21.561404 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:21.568641 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-a83a971f-620e-43f1-9df8-dfbd9f420a88 req-7b0af44e-7f1f-40a6-ac4e-ebb52493e143 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:21.569328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-a83a971f-620e-43f1-9df8-dfbd9f420a88 req-7b0af44e-7f1f-40a6-ac4e-ebb52493e143 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:21.569949 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-a83a971f-620e-43f1-9df8-dfbd9f420a88 req-7b0af44e-7f1f-40a6-ac4e-ebb52493e143 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:21.581724 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-a83a971f-620e-43f1-9df8-dfbd9f420a88 req-7b0af44e-7f1f-40a6-ac4e-ebb52493e143 service nova] Creating event network-changed:2a20279b-5dcc-41a2-ac81-47e5c15b62b8 for instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e on hv-cinder-86022 Oct 31 15:07:21.589002 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-a83a971f-620e-43f1-9df8-dfbd9f420a88 req-7b0af44e-7f1f-40a6-ac4e-ebb52493e143 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042678 Oct 31 15:07:21.590097 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 532/1012] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:21.824940 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:21.835780 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f055c6a3-5358-48a8-b203-dcda76c5f1d7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1759 microversion: 2.1 time: 0.309597 Oct 31 15:07:21.841289 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 481/1013] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:21 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1759 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:21.928206 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:21.929090 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:21.935420 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:21.936312 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:21.936843 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:21.937643 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:21.938224 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:21.938754 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:22.090230 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:22.097908 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cc43ca64-5929-4dd6-ad74-cdc57818326d tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1452 microversion: 2.1 time: 0.174570 Oct 31 15:07:22.111601 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 533/1014] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:21 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:22.120426 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:22.121272 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:22.128229 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:22.128707 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:22.129136 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:22.129827 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:22.131056 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:22.131481 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:22.308643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:22.316435 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-61aeac6c-8878-4478-863f-c31ff80dad32 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1452 microversion: 2.1 time: 0.199862 Oct 31 15:07:22.317031 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 482/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:22 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:23.866844 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-b7c1a861-e0e7-4d9d-870a-beb98ebdcc03 req-889d142c-e90e-486e-aefc-ade0e61d501b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8fb6758-3ce0-4d41-9f6c-60d461c90d66", "tag": "01c6e9f9-8dac-4996-b9c6-53898d243ad8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:23.877217 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b7c1a861-e0e7-4d9d-870a-beb98ebdcc03 req-889d142c-e90e-486e-aefc-ade0e61d501b service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:23.877689 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b7c1a861-e0e7-4d9d-870a-beb98ebdcc03 req-889d142c-e90e-486e-aefc-ade0e61d501b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:23.878177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b7c1a861-e0e7-4d9d-870a-beb98ebdcc03 req-889d142c-e90e-486e-aefc-ade0e61d501b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:23.889706 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-b7c1a861-e0e7-4d9d-870a-beb98ebdcc03 req-889d142c-e90e-486e-aefc-ade0e61d501b service nova] Creating event network-changed:01c6e9f9-8dac-4996-b9c6-53898d243ad8 for instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 on hv-cinder-86022 Oct 31 15:07:23.894620 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-b7c1a861-e0e7-4d9d-870a-beb98ebdcc03 req-889d142c-e90e-486e-aefc-ade0e61d501b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031972 Oct 31 15:07:23.895265 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 534/1016] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:47.438748 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c9f01f53-71cb-41a7-9b7d-58459287fb62 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:47.441118 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c9f01f53-71cb-41a7-9b7d-58459287fb62 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:47.443468 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=39 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:47.444151 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=76 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:47.450422 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c9f01f53-71cb-41a7-9b7d-58459287fb62 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:47.450905 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c9f01f53-71cb-41a7-9b7d-58459287fb62 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:47.451340 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c9f01f53-71cb-41a7-9b7d-58459287fb62 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:47.452055 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c9f01f53-71cb-41a7-9b7d-58459287fb62 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:47.452515 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c9f01f53-71cb-41a7-9b7d-58459287fb62 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:47.452938 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c9f01f53-71cb-41a7-9b7d-58459287fb62 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:47.527078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c9f01f53-71cb-41a7-9b7d-58459287fb62 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "POST /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/action" status: 202 len: 0 microversion: 2.1 time: 0.092221 Oct 31 15:07:47.527925 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 483/1017] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 15:07:47 2022] POST /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:07:47.536275 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:47.536978 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:47.540617 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=21 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:47.541274 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:47.546435 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:47.546908 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:47.547340 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:47.548107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:47.548553 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:47.548989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:47.697055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:47.705789 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-10447609-a2a8-45e9-813a-7617d174ea65 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1751 microversion: 2.1 time: 0.173536 Oct 31 15:07:47.706391 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 535/1018] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:47 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:48.730480 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:48.731204 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:48.737343 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:48.737816 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:48.738244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:48.738926 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:48.739370 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:48.739826 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:48.883200 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:48.891986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-59edc1e8-3400-4619-bef0-c8f4c8618011 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1756 microversion: 2.1 time: 0.167012 Oct 31 15:07:48.892541 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 484/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:48 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:49.916454 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:49.917071 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:49.923442 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:49.923948 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:49.924379 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:49.925063 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:49.925510 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:49.925933 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:50.068077 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:50.076295 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a8e399d0-fbdb-4b3c-8b02-e16961344053 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1756 microversion: 2.1 time: 0.164191 Oct 31 15:07:50.076856 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 536/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:49 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:51.100146 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:51.100760 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:51.107234 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:51.107764 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:51.108202 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:51.108893 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:51.109345 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:51.109765 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:51.254175 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:51.262929 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d1f9c73a-c933-443f-9429-e002b230116c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1756 microversion: 2.1 time: 0.166645 Oct 31 15:07:51.263500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 485/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:51 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:52.287318 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:52.287959 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:52.294416 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:52.294892 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:52.295327 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:52.296041 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:52.296493 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:52.296915 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:52.435289 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:52.443781 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-fd38975c-8ca5-4850-abbf-9288baec4bcb tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1756 microversion: 2.1 time: 0.160322 Oct 31 15:07:52.444352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 537/1022] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:52 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:53.468027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:53.468693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:53.475088 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:53.475587 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:53.476025 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:53.476713 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:53.477952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:53.478476 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:53.618125 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:53.626360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f89d5cb9-f694-4ece-a327-98824de54662 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1756 microversion: 2.1 time: 0.162234 Oct 31 15:07:53.626917 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 486/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:53 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:54.649869 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:54.650589 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:54.657085 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:54.657566 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:54.658005 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:54.658695 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:54.659146 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:54.659590 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:54.801999 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:54.810403 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c40ea904-3ee2-48ae-9f15-173f0d86971a tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1756 microversion: 2.1 time: 0.164948 Oct 31 15:07:54.810962 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 538/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:54 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:55.834389 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:55.834902 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:55.841813 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:55.842291 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:55.842722 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:55.843400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:55.843872 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:55.844290 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:55.986895 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:55.995106 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b0d79b76-262b-4af9-bb4a-a3820b379188 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1756 microversion: 2.1 time: 0.164668 Oct 31 15:07:55.995693 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 487/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:55 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:57.018560 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:57.019193 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:57.025682 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:57.026163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:57.026599 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:57.027290 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:57.027865 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:57.028319 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:57.170967 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:57.179177 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-192ff7f7-4e34-4eab-9306-e037eacbad1d tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1756 microversion: 2.1 time: 0.164591 Oct 31 15:07:57.179768 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 539/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:57 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:58.203313 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:58.203986 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:58.210449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:58.210932 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:58.211367 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:58.212152 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:58.212604 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:58.213024 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:58.352599 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:58.360941 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-098a4c6a-0bcb-44d0-b4d9-eccf62d56180 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1756 microversion: 2.1 time: 0.161471 Oct 31 15:07:58.361538 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 488/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:58 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:59.386069 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:59.386668 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:07:59.393640 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:59.394123 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:59.394557 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:59.395248 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:07:59.395732 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:07:59.396153 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:07:59.538843 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:07:59.547233 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-ca1c6e59-35a4-41a7-b929-43e26e37e423 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1759 microversion: 2.1 time: 0.165928 Oct 31 15:07:59.547823 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 540/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:07:59 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:32.323667 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-742568136"}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:32.324304 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:32.326331 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=12 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:32.327012 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:32.334403 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:32.334882 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:32.335913 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:32.336668 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:32.337122 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:32.337567 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:32.464487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.network.security_group_api [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Removing security group 4358da55-f39b-4285-a328-d4eb6dcf9d26 from port 2a20279b-5dcc-41a2-ac81-47e5c15b62b8 Oct 31 15:08:32.779249 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-917ea9a0-cbe3-4863-8416-27f70d5f6d48 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "POST /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/action" status: 202 len: 0 microversion: 2.1 time: 0.459691 Oct 31 15:08:32.783453 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 489/1029] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 31 15:08:32 2022] POST /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:08:32.789622 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-9573f7f5-ae48-41b0-8033-30a0d99ad89a req-d74df890-78c6-4707-8763-4fd30ac1aec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cc9303-4a2f-44f1-84cf-b21cbfc2281e", "tag": "2a20279b-5dcc-41a2-ac81-47e5c15b62b8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:32.794838 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=12 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:32.795517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=36 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:32.810951 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9573f7f5-ae48-41b0-8033-30a0d99ad89a req-d74df890-78c6-4707-8763-4fd30ac1aec5 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:32.811431 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9573f7f5-ae48-41b0-8033-30a0d99ad89a req-d74df890-78c6-4707-8763-4fd30ac1aec5 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:32.824104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9573f7f5-ae48-41b0-8033-30a0d99ad89a req-d74df890-78c6-4707-8763-4fd30ac1aec5 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:32.837487 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-9573f7f5-ae48-41b0-8033-30a0d99ad89a req-d74df890-78c6-4707-8763-4fd30ac1aec5 service nova] Creating event network-changed:2a20279b-5dcc-41a2-ac81-47e5c15b62b8 for instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e on hv-cinder-86022 Oct 31 15:08:32.853387 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-9573f7f5-ae48-41b0-8033-30a0d99ad89a req-d74df890-78c6-4707-8763-4fd30ac1aec5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067213 Oct 31 15:08:32.855225 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 541/1030] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:08:33.848973 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:33.850099 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:33.864950 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-45f1b5ee-7f0b-4842-975b-5598b2f8950d req-fcb91583-de2d-4a62-8165-2039e53a0c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a84bc4d-cc6e-455f-a958-b9e62714400b", "tag": "14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:33.872230 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:33.873131 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:33.873683 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:33.874521 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:33.875082 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:33.875659 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:33.893582 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-45f1b5ee-7f0b-4842-975b-5598b2f8950d req-fcb91583-de2d-4a62-8165-2039e53a0c63 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:33.894064 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-45f1b5ee-7f0b-4842-975b-5598b2f8950d req-fcb91583-de2d-4a62-8165-2039e53a0c63 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:33.894498 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-45f1b5ee-7f0b-4842-975b-5598b2f8950d req-fcb91583-de2d-4a62-8165-2039e53a0c63 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:33.906643 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-45f1b5ee-7f0b-4842-975b-5598b2f8950d req-fcb91583-de2d-4a62-8165-2039e53a0c63 service nova] Creating event network-changed:14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae for instance 8a84bc4d-cc6e-455f-a958-b9e62714400b on hv-cinder-86022 Oct 31 15:08:33.911573 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-45f1b5ee-7f0b-4842-975b-5598b2f8950d req-fcb91583-de2d-4a62-8165-2039e53a0c63 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051263 Oct 31 15:08:33.912720 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 542/1031] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:33.920421 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:08:34.019681 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-7147ca81-153e-4b79-819a-6b5700f87ebe tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 204 len: 0 microversion: 2.1 time: 0.174205 Oct 31 15:08:34.023825 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 490/1032] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:08:33 2022] DELETE /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:08:34.029419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:34.030131 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:34.036281 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:34.036771 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:34.037209 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:34.037961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:34.039659 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:34.040261 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:34.184520 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:34.193522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-34c65dba-f8a4-455f-b183-71ad2bceabca tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.167988 Oct 31 15:08:34.194438 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 543/1033] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:34 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:34.348739 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:34.349398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:34.359682 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:34.360172 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:34.360610 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:34.361321 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:34.361775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:34.362203 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:34.449812 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lazy-loading 'services' on Instance uuid d9cc9303-4a2f-44f1-84cf-b21cbfc2281e {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:08:34.534467 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ffbdab3b-43b4-46be-b104-29da47682d5e tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments/b57221e3-6361-4a22-a34d-e92193d757ac" status: 202 len: 0 microversion: 2.1 time: 0.190378 Oct 31 15:08:34.535378 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 491/1034] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:08:34 2022] DELETE /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments/b57221e3-6361-4a22-a34d-e92193d757ac => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:08:34.544111 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-81641c06-01cd-4f16-ac52-9889dcaf38b7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:34.546432 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-81641c06-01cd-4f16-ac52-9889dcaf38b7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:34.552630 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81641c06-01cd-4f16-ac52-9889dcaf38b7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:34.553543 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81641c06-01cd-4f16-ac52-9889dcaf38b7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:34.556831 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81641c06-01cd-4f16-ac52-9889dcaf38b7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:34.557599 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81641c06-01cd-4f16-ac52-9889dcaf38b7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:34.558107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81641c06-01cd-4f16-ac52-9889dcaf38b7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:34.558585 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-81641c06-01cd-4f16-ac52-9889dcaf38b7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:34.592710 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-81641c06-01cd-4f16-ac52-9889dcaf38b7 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052439 Oct 31 15:08:34.593294 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 544/1035] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:08:34 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:34.872984 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-955e55a2-a246-45d0-8c83-85896b4f4a0c req-b583be8a-c0e5-49f3-9d10-077f6e464654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cc9303-4a2f-44f1-84cf-b21cbfc2281e", "tag": "2a20279b-5dcc-41a2-ac81-47e5c15b62b8"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:34.883703 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-955e55a2-a246-45d0-8c83-85896b4f4a0c req-b583be8a-c0e5-49f3-9d10-077f6e464654 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:34.884182 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-955e55a2-a246-45d0-8c83-85896b4f4a0c req-b583be8a-c0e5-49f3-9d10-077f6e464654 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:34.884615 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-955e55a2-a246-45d0-8c83-85896b4f4a0c req-b583be8a-c0e5-49f3-9d10-077f6e464654 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:34.896192 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-955e55a2-a246-45d0-8c83-85896b4f4a0c req-b583be8a-c0e5-49f3-9d10-077f6e464654 service nova] Creating event network-changed:2a20279b-5dcc-41a2-ac81-47e5c15b62b8 for instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e on hv-cinder-86022 Oct 31 15:08:34.901964 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-955e55a2-a246-45d0-8c83-85896b4f4a0c req-b583be8a-c0e5-49f3-9d10-077f6e464654 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033494 Oct 31 15:08:34.902566 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 492/1036] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:35.217324 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:35.218043 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:35.224740 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:35.225352 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:35.226024 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:35.226723 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:35.227333 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:35.227946 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:35.367657 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:35.375792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7181f19e-fec2-469b-a5e7-2e0e2bd3f454 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.162264 Oct 31 15:08:35.376375 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 545/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:35 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:35.605947 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-c955ae95-a735-4539-99e5-b166fd1ee7ed tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:35.608197 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-c955ae95-a735-4539-99e5-b166fd1ee7ed tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:35.614347 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c955ae95-a735-4539-99e5-b166fd1ee7ed tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:35.614820 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c955ae95-a735-4539-99e5-b166fd1ee7ed tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:35.615247 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c955ae95-a735-4539-99e5-b166fd1ee7ed tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:35.615952 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c955ae95-a735-4539-99e5-b166fd1ee7ed tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:35.616970 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c955ae95-a735-4539-99e5-b166fd1ee7ed tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:35.617397 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-c955ae95-a735-4539-99e5-b166fd1ee7ed tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:35.645314 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-c955ae95-a735-4539-99e5-b166fd1ee7ed tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Oct 31 15:08:35.645859 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 493/1038] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:08:35 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:36.500125 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:36.500775 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:36.506743 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:36.507904 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:36.508466 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:36.509163 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:36.509621 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:36.510043 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:36.648505 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6dc53b3c9e041a7ae977b8f9c4fb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cf607c19548859a14c92a4e90f148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:36.657993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-0903fe0b-231d-45a6-a9b1-2453208648e2 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 200 len: 1567 microversion: 2.1 time: 0.261423 Oct 31 15:08:36.659181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 546/1039] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:36 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:36.659653 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-50fffed9-193a-4cb9-9889-16f900077f0f tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:36.662482 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-50fffed9-193a-4cb9-9889-16f900077f0f tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:36.669360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-50fffed9-193a-4cb9-9889-16f900077f0f tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:36.670095 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-50fffed9-193a-4cb9-9889-16f900077f0f tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:36.670677 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-50fffed9-193a-4cb9-9889-16f900077f0f tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:36.671376 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-50fffed9-193a-4cb9-9889-16f900077f0f tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:36.671846 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-50fffed9-193a-4cb9-9889-16f900077f0f tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:36.672264 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-50fffed9-193a-4cb9-9889-16f900077f0f tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:36.702648 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-50fffed9-193a-4cb9-9889-16f900077f0f tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048291 Oct 31 15:08:36.703212 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 494/1040] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 31 15:08:36 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:08:36.714020 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:36.714517 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:36.720571 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:36.720971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:36.721402 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:36.722096 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:36.722545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:36.722966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:36.801726 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] HTTP exception thrown: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e is not attached to volume b57221e3-6361-4a22-a34d-e92193d757ac Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Request method failure captured: Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: DELETE /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments/b57221e3-6361-4a22-a34d-e92193d757ac HTTP/1.1 Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-R3kwvgRywSv_bQx-rqfZs0Q_oFihDvj5PaS7DDI6HA-qU3a_jb2rkcrdB24Ep6wNFxWAcFExpvej4QmUV6ClH8t7W_K48kV7FZSywAXv_5-UGMQxjotGYmkk3slPso789Nb1Ej7dPg0c7ach2Bv5GcokIZiwYXHlMGylDk0vmnX9w Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 87556dde63c246f78107d7191fe9a177 Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-TestMinimumBasicScenario-1769742441 Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:08:36.804734 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87556dde63c246f78107d7191fe9a177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87556dde63c246f78107d7191fe9a177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_87556dde63c246f78107d7191fe9a177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/87556dde63c246f78107d7191fe9a177"}]}] Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-TestMinimumBasicScenario-1769742441 Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 87556dde63c246f78107d7191fe9a177 Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1769742441 Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-TestMinimumBasicScenario-1769742441-project Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: 0ba4c7a65d8b41e3addbbeba841d79ea Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-TestMinimumBasicScenario-1769742441-project Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:08:36.806458 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e is not attached to volume b57221e3-6361-4a22-a34d-e92193d757ac Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'server_id': 'd9cc9303-4a2f-44f1-84cf-b21cbfc2281e', 'id': 'b57221e3-6361-4a22-a34d-e92193d757ac'} Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b57221e3-6361-4a22-a34d-e92193d757ac. Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:36.807989 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e is not attached to volume b57221e3-6361-4a22-a34d-e92193d757ac Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e is not attached to volume b57221e3-6361-4a22-a34d-e92193d757ac Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:36.809971 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Returning 404 to user: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e is not attached to volume b57221e3-6361-4a22-a34d-e92193d757ac {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:36.811593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-5973e7d9-84bc-435f-b3a9-959b6d388f7c tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments/b57221e3-6361-4a22-a34d-e92193d757ac" status: 404 len: 154 microversion: 2.1 time: 0.096421 Oct 31 15:08:36.811593 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 547/1041] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 31 15:08:36 2022] DELETE /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e/os-volume_attachments/b57221e3-6361-4a22-a34d-e92193d757ac => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:08:36.917180 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-f7cf099b-8b29-4c35-a05d-1e58a3c873fa req-7b35a6d2-c453-4942-994d-de713442f2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a84bc4d-cc6e-455f-a958-b9e62714400b", "name": "network-vif-deleted", "tag": "14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:36.926602 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-f7cf099b-8b29-4c35-a05d-1e58a3c873fa req-7b35a6d2-c453-4942-994d-de713442f2f3 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:36.927173 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-f7cf099b-8b29-4c35-a05d-1e58a3c873fa req-7b35a6d2-c453-4942-994d-de713442f2f3 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:36.927696 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-f7cf099b-8b29-4c35-a05d-1e58a3c873fa req-7b35a6d2-c453-4942-994d-de713442f2f3 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:36.939213 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-f7cf099b-8b29-4c35-a05d-1e58a3c873fa req-7b35a6d2-c453-4942-994d-de713442f2f3 service nova] Creating event network-vif-deleted:14d95c60-3af1-44e6-8f2c-e5c70ad2e2ae for instance 8a84bc4d-cc6e-455f-a958-b9e62714400b on hv-cinder-86022 Oct 31 15:08:36.944460 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-f7cf099b-8b29-4c35-a05d-1e58a3c873fa req-7b35a6d2-c453-4942-994d-de713442f2f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031697 Oct 31 15:08:36.945322 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 495/1042] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:37.682497 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:37.683103 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] [instance: 8a84bc4d-cc6e-455f-a958-b9e62714400b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:37.689543 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:37.690026 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:37.690437 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:37.691117 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:37.691578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:37.691996 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:37.706195 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] HTTP exception thrown: Instance 8a84bc4d-cc6e-455f-a958-b9e62714400b could not be found. Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Request method failure captured: Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b HTTP/1.1 Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-PDQ3bEhBWaXVjGAUldBx5F-us7GQdaIR6jCa1cPx9Y3ShMeU_MPUWUoBK-f7SpiyNli8gxdcj8jVwr-dy-Ln7lbpMNClPkinfoyeij2iks15J9hat3xZLJzipQneKz1T5XN9zWHndlwodxynuvy4BSWZ2W1gwOoa06wcqL0RiQXrs Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: 357cf607c19548859a14c92a4e90f148 Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-TestShelveInstance-723689958 Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:08:37.707725 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/357cf607c19548859a14c92a4e90f148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/357cf607c19548859a14c92a4e90f148"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_357cf607c19548859a14c92a4e90f148"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/357cf607c19548859a14c92a4e90f148"}]}] Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-TestShelveInstance-723689958 Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: 357cf607c19548859a14c92a4e90f148 Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-TestShelveInstance-723689958 Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-TestShelveInstance-723689958-project Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: c6dc53b3c9e041a7ae977b8f9c4fb478 Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-TestShelveInstance-723689958-project Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 8a84bc4d-cc6e-455f-a958-b9e62714400b could not be found. Oct 31 15:08:37.709345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '8a84bc4d-cc6e-455f-a958-b9e62714400b'} Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a84bc4d-cc6e-455f-a958-b9e62714400b could not be found. Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:37.710280 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a84bc4d-cc6e-455f-a958-b9e62714400b could not be found. Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a84bc4d-cc6e-455f-a958-b9e62714400b could not be found. Oct 31 15:08:37.711655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:08:37.712850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Returning 404 to user: Instance 8a84bc4d-cc6e-455f-a958-b9e62714400b could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:37.712850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-aa55ebdb-7012-48dd-ae52-660bb06aec97 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b" status: 404 len: 111 microversion: 2.1 time: 0.030458 Oct 31 15:08:37.712850 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 548/1043] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:37 2022] GET /compute/v2.1/servers/8a84bc4d-cc6e-455f-a958-b9e62714400b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:08:37.866090 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-e5d51308-e12f-45b8-8a94-b22915d04943 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] Calling method '.version_select at 0x7f6c70f18670>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:37.886861 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-e5d51308-e12f-45b8-8a94-b22915d04943 tempest-TestShelveInstance-723689958 tempest-TestShelveInstance-723689958-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-636517032" status: 202 len: 0 microversion: 2.1 time: 0.025654 Oct 31 15:08:37.887444 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 496/1044] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 31 15:08:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-636517032 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:08:37.959451 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:37.959995 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:37.966052 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:37.966545 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:37.966983 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:37.967705 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:37.968156 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:37.968577 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:37.994328 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Going to try to terminate instance {{(pid=134339) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:08:38.070833 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-e59e2cd0-e1c2-4788-93eb-37e2f489be05 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 204 len: 0 microversion: 2.1 time: 0.114651 Oct 31 15:08:38.071701 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 549/1045] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:08:37 2022] DELETE /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:08:38.080261 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:38.080990 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:38.088741 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:38.089307 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:38.089908 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:38.090691 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:38.091218 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:38.091741 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:38.313654 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:38.322539 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-5722ecac-64b6-4554-b732-8f0b7c240eab tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1554 microversion: 2.1 time: 0.246190 Oct 31 15:08:38.323068 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 497/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:38 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:08:39.346348 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:39.347125 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:39.354001 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:39.354612 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:39.355057 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:39.355792 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:39.356238 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:39.356655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:39.599181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:39.608872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6b75cd4e-b206-45b3-8623-512de4589185 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1554 microversion: 2.1 time: 0.266673 Oct 31 15:08:39.610072 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 550/1047] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:39 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1554 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:40.633153 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:40.633778 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:40.640606 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:40.641096 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:40.641530 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:40.642236 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:40.642711 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:40.643111 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:40.905409 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba4c7a65d8b41e3addbbeba841d79ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87556dde63c246f78107d7191fe9a177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:40.922039 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-0d9f9f20-3101-4651-b508-707ece43c676 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 200 len: 1512 microversion: 2.1 time: 0.293388 Oct 31 15:08:40.922711 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 498/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:40 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:40.939102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-f7e83c97-f890-4e46-9e47-8af13fff08d5 req-e6e6d4ba-f4d9-4589-94e9-b8faee7869e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cc9303-4a2f-44f1-84cf-b21cbfc2281e", "name": "network-vif-deleted", "tag": "2a20279b-5dcc-41a2-ac81-47e5c15b62b8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:40.963883 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-f7e83c97-f890-4e46-9e47-8af13fff08d5 req-e6e6d4ba-f4d9-4589-94e9-b8faee7869e7 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:40.964727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-f7e83c97-f890-4e46-9e47-8af13fff08d5 req-e6e6d4ba-f4d9-4589-94e9-b8faee7869e7 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:40.965646 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-f7e83c97-f890-4e46-9e47-8af13fff08d5 req-e6e6d4ba-f4d9-4589-94e9-b8faee7869e7 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:40.994963 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-f7e83c97-f890-4e46-9e47-8af13fff08d5 req-e6e6d4ba-f4d9-4589-94e9-b8faee7869e7 service nova] Creating event network-vif-deleted:2a20279b-5dcc-41a2-ac81-47e5c15b62b8 for instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e on hv-cinder-86022 Oct 31 15:08:40.999715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-f7e83c97-f890-4e46-9e47-8af13fff08d5 req-e6e6d4ba-f4d9-4589-94e9-b8faee7869e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081696 Oct 31 15:08:41.000669 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 551/1049] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:41.954387 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:41.955011 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] [instance: d9cc9303-4a2f-44f1-84cf-b21cbfc2281e] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:41.963195 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:41.964027 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:41.964549 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:41.965326 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:41.966439 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:41.966961 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:41.982105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] HTTP exception thrown: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e could not be found. Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Request method failure captured: Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e HTTP/1.1 Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-R3kwvgRywSv_bQx-rqfZs0Q_oFihDvj5PaS7DDI6HA-qU3a_jb2rkcrdB24Ep6wNFxWAcFExpvej4QmUV6ClH8t7W_K48kV7FZSywAXv_5-UGMQxjotGYmkk3slPso789Nb1Ej7dPg0c7ach2Bv5GcokIZiwYXHlMGylDk0vmnX9w Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: 87556dde63c246f78107d7191fe9a177 Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-TestMinimumBasicScenario-1769742441 Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:08:41.984005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87556dde63c246f78107d7191fe9a177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87556dde63c246f78107d7191fe9a177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_87556dde63c246f78107d7191fe9a177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/87556dde63c246f78107d7191fe9a177"}]}] Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-TestMinimumBasicScenario-1769742441 Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: 87556dde63c246f78107d7191fe9a177 Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1769742441 Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-TestMinimumBasicScenario-1769742441-project Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: 0ba4c7a65d8b41e3addbbeba841d79ea Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-TestMinimumBasicScenario-1769742441-project Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e could not be found. Oct 31 15:08:41.985666 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': 'd9cc9303-4a2f-44f1-84cf-b21cbfc2281e'} Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e could not be found. Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:41.986734 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e could not be found. Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e could not be found. Oct 31 15:08:41.988385 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:08:41.992092 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Returning 404 to user: Instance d9cc9303-4a2f-44f1-84cf-b21cbfc2281e could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:41.993189 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a29cbd30-75c8-454f-b6f4-e31c8dde5d86 tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e" status: 404 len: 111 microversion: 2.1 time: 0.043020 Oct 31 15:08:41.993961 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 499/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:41 2022] GET /compute/v2.1/servers/d9cc9303-4a2f-44f1-84cf-b21cbfc2281e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:08:42.002932 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-86a43d52-6867-4362-9bea-ac68cf3c79fa tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] Calling method '.version_select at 0x7f6c70f698b0>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:42.029330 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-86a43d52-6867-4362-9bea-ac68cf3c79fa tempest-TestMinimumBasicScenario-1769742441 tempest-TestMinimumBasicScenario-1769742441-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-693443362" status: 202 len: 0 microversion: 2.1 time: 0.030904 Oct 31 15:08:42.029906 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 552/1051] 10.222.0.36 () {58 vars in 1269 bytes} [Mon Oct 31 15:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-693443362 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:08:58.829301 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-265175601", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2106455873", "security_groups": [{"name": "tempest-secgroup-smoke-825469118"}], "block_device_mapping_v2": [{"uuid": "b0485ed3-afee-4a6d-8af3-d0b08b19e7d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3aa20268-e1a0-450c-8a2f-a6e3730c1b1e"}]}} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:58.840795 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:58.841438 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:58.950065 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.network.neutron [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] validate_networks() for [('3aa20268-e1a0-450c-8a2f-a6e3730c1b1e', None, None, None, None, None)] {{(pid=134338) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:08:59.313348 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Flavor limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:08:59.313777 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Image limits 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:08:59.314252 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Flavor pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:08:59.314662 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Image pref 0:0:0 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:08:59.315078 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.virt.hardware [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:08:59.324690 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:59.325174 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:59.325609 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:59.326372 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:08:59.326825 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:08:59.327250 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:08:59.344600 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Getting quotas for project d7f5a9331dd54d9e8b5033234cb1077a. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:08:59.348705 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.quota [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Getting quotas for user f0b358738b5a46d8bc1db1da68040c8f and project d7f5a9331dd54d9e8b5033234cb1077a. Resources: {'cores', 'instances', 'ram'} {{(pid=134338) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:08:59.408285 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Going to run 1 instances... {{(pid=134338) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:08:59.410447 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0485ed3-afee-4a6d-8af3-d0b08b19e7d2',volume_size=None,volume_type=None)] {{(pid=134338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:08:59.538976 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d1af543a-37f4-431c-b50b-67278a225c93 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.713470 Oct 31 15:08:59.539658 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 500/1052] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 31 15:08:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:08:59.548537 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:59.549285 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:59.555121 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-7c1c7fab-c2ea-4cc8-a1ea-5d7199df0789 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:59.556263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-7c1c7fab-c2ea-4cc8-a1ea-5d7199df0789 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:08:59.620738 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-7c1c7fab-c2ea-4cc8-a1ea-5d7199df0789 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:08:59.628334 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-7c1c7fab-c2ea-4cc8-a1ea-5d7199df0789 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1094 microversion: 2.1 time: 0.081583 Oct 31 15:08:59.628893 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 553/1053] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:08:59 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:00.652083 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:00.652663 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:00.659463 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:00.660132 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:00.660569 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:00.661271 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:00.661726 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:00.662149 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:00.746944 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:00.754921 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-6ae5ce5f-8f30-4cb7-b735-549c02103579 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1200 microversion: 2.1 time: 0.107033 Oct 31 15:09:00.755489 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 501/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:00 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:01.778362 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:01.779057 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:01.785626 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:01.786218 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:01.786653 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:01.787930 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:01.788495 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:01.788917 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:01.926872 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:01.935411 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1ffdd650-1de3-4f42-a9f9-2c7f20f42b69 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.160878 Oct 31 15:09:01.936042 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 554/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:01 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:02.034297 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [req-07f4dd76-e8ea-4042-a114-d84d6cff33f8 req-208b4c74-fbe4-4040-830e-dfa92826fce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d5e18db-c0c5-4201-87d5-890679097b1b", "tag": "61b79242-a3fb-45f8-8cae-9a795c2147e0"}]} {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:02.045325 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-07f4dd76-e8ea-4042-a114-d84d6cff33f8 req-208b4c74-fbe4-4040-830e-dfa92826fce7 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:02.045901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-07f4dd76-e8ea-4042-a114-d84d6cff33f8 req-208b4c74-fbe4-4040-830e-dfa92826fce7 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:02.046500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [req-07f4dd76-e8ea-4042-a114-d84d6cff33f8 req-208b4c74-fbe4-4040-830e-dfa92826fce7 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:02.059593 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.compute.server_external_events [req-07f4dd76-e8ea-4042-a114-d84d6cff33f8 req-208b4c74-fbe4-4040-830e-dfa92826fce7 service nova] Creating event network-changed:61b79242-a3fb-45f8-8cae-9a795c2147e0 for instance 5d5e18db-c0c5-4201-87d5-890679097b1b on hv-cinder-86022 Oct 31 15:09:02.064896 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [req-07f4dd76-e8ea-4042-a114-d84d6cff33f8 req-208b4c74-fbe4-4040-830e-dfa92826fce7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034477 Oct 31 15:09:02.065476 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 502/1056] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:02.958260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:02.958993 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:02.966418 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:02.966907 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:02.967358 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:02.968068 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:02.968515 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:02.968932 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:03.100655 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:03.108387 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-c7e8a4bb-f1b1-4f20-91c4-87bb10fca83e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.154097 Oct 31 15:09:03.109176 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 555/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:02 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:04.132187 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:04.132873 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:04.138935 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:04.139399 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:04.139858 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:04.140535 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:04.140977 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:04.141391 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:04.270068 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:04.278597 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-94e79e28-b1e6-4c66-bbdf-8d35b4a10a2a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.151305 Oct 31 15:09:04.279151 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 503/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:04 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:05.301338 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:05.302006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:05.309055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:05.309538 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:05.309970 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:05.310654 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:05.311102 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:05.311522 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:05.446756 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:05.454453 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-29a71d07-2b95-49e0-820b-dc42dd393727 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.156918 Oct 31 15:09:05.455143 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 556/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:05 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:06.478343 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:06.478956 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:06.485398 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:06.485879 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:06.486311 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:06.486999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:06.487449 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:06.487901 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:06.625756 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:06.634614 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-29e569a0-3c10-45f2-8760-cf96d98b5b9e tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.160275 Oct 31 15:09:06.635173 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 504/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:06 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:07.657729 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:07.658367 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:07.665018 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:07.665499 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:07.665953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:07.666616 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:07.667064 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:07.667484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:07.795601 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:07.803334 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-02ba3169-3653-4224-844b-0597cab86aba tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.149616 Oct 31 15:09:07.803927 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 557/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:07 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:08.826724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:08.827337 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:08.833776 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:08.834282 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:08.834715 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:08.835400 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:08.835877 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:08.836298 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:08.963492 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:08.971127 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-ce431114-4f11-4279-83e6-7b062580fde1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.148322 Oct 31 15:09:08.971714 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 505/1062] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:08 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:09.994434 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:09.995631 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:09.998156 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell0:SELECT=2 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:10.003256 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:10.003778 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:10.004260 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:10.004961 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:10.005414 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:10.006429 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:10.140305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:10.148778 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1674cc2e-7556-418c-a968-7873133a540a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.158710 Oct 31 15:09:10.149358 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 558/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:09 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:11.171891 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:11.172501 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:11.174418 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=2 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:11.175069 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell0:SELECT=6 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:11.182016 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:11.182499 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:11.182930 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:11.183639 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:11.184092 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:11.184515 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:11.319487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:11.327244 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-f637efda-5fd7-406c-95fe-f0bab38359d3 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.159296 Oct 31 15:09:11.327857 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 506/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:11 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:09:11.867765 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-e9c17c38-aa36-4f16-99d5-710439be0ae6 req-a2d2924f-bf7e-46b2-b6c6-e953e198a91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5e18db-c0c5-4201-87d5-890679097b1b", "name": "network-vif-plugged", "status": "completed", "tag": "61b79242-a3fb-45f8-8cae-9a795c2147e0"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:11.877043 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-e9c17c38-aa36-4f16-99d5-710439be0ae6 req-a2d2924f-bf7e-46b2-b6c6-e953e198a91b service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:11.877514 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-e9c17c38-aa36-4f16-99d5-710439be0ae6 req-a2d2924f-bf7e-46b2-b6c6-e953e198a91b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:11.877940 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-e9c17c38-aa36-4f16-99d5-710439be0ae6 req-a2d2924f-bf7e-46b2-b6c6-e953e198a91b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:11.890923 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-e9c17c38-aa36-4f16-99d5-710439be0ae6 req-a2d2924f-bf7e-46b2-b6c6-e953e198a91b service nova] Creating event network-vif-plugged:61b79242-a3fb-45f8-8cae-9a795c2147e0 for instance 5d5e18db-c0c5-4201-87d5-890679097b1b on hv-cinder-86022 Oct 31 15:09:11.895964 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-e9c17c38-aa36-4f16-99d5-710439be0ae6 req-a2d2924f-bf7e-46b2-b6c6-e953e198a91b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153136 Oct 31 15:09:11.897283 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 559/1065] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:12.349988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:12.350663 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:12.357119 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:12.357545 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:12.357974 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:12.358660 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:12.359118 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:12.359538 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:12.485848 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:12.493450 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4546ac24-7a36-4051-a8d0-ced59697be8a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1265 microversion: 2.1 time: 0.147532 Oct 31 15:09:12.494015 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 507/1066] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:12 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:13.517419 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:13.518176 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:13.524953 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:13.525430 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:13.525867 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:13.526559 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:13.527009 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:13.527428 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:13.661496 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:13.669484 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-cd95c5de-a026-456b-aacb-d57aaff56ea7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1452 microversion: 2.1 time: 0.156891 Oct 31 15:09:13.670055 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 560/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:13 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:13.691471 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:13.692125 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:09:13.699486 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:13.700005 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:13.700445 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:13.701141 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:13.701598 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:13.702028 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:13.838798 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:09:13.846592 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-4bacfcd8-3503-4a28-83be-9661c4587d78 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1452 microversion: 2.1 time: 0.158910 Oct 31 15:09:13.847160 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 508/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:09:13 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:09:15.650899 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-9636544f-f170-4c1e-b3ba-25416d1fa51c req-6c49e330-2692-419e-9744-4e64e99b9db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d5e18db-c0c5-4201-87d5-890679097b1b", "tag": "61b79242-a3fb-45f8-8cae-9a795c2147e0"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:09:15.660305 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9636544f-f170-4c1e-b3ba-25416d1fa51c req-6c49e330-2692-419e-9744-4e64e99b9db1 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:09:15.660874 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9636544f-f170-4c1e-b3ba-25416d1fa51c req-6c49e330-2692-419e-9744-4e64e99b9db1 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:09:15.661372 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-9636544f-f170-4c1e-b3ba-25416d1fa51c req-6c49e330-2692-419e-9744-4e64e99b9db1 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:09:15.672240 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-9636544f-f170-4c1e-b3ba-25416d1fa51c req-6c49e330-2692-419e-9744-4e64e99b9db1 service nova] Creating event network-changed:61b79242-a3fb-45f8-8cae-9a795c2147e0 for instance 5d5e18db-c0c5-4201-87d5-890679097b1b on hv-cinder-86022 Oct 31 15:09:15.677223 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-9636544f-f170-4c1e-b3ba-25416d1fa51c req-6c49e330-2692-419e-9744-4e64e99b9db1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030036 Oct 31 15:09:15.678314 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 561/1069] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:47.796789 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:47.797284 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR oslo.messaging._drivers.impl_rabbit [-] [15957ba2-74d4-4b57-8319-6e896e1f260c] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:10:47.797671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:47.797780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_api:SELECT=20 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.798566 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG dbcounter [-] [134339] Writing DB stats nova_cell1:SELECT=40 {{(pid=134339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.800461 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.802725 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG dbcounter [-] [134338] Writing DB stats nova_cell1:SELECT=46 {{(pid=134338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.803934 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-67a3bec6-feff-425f-9092-cfd99b92b5d5 req-fd04763b-12a6-4df6-b2e5-19c6c9bde97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d5e18db-c0c5-4201-87d5-890679097b1b", "tag": "61b79242-a3fb-45f8-8cae-9a795c2147e0"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:47.804339 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 15:10:47.804561 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Mon Oct 31 15:10:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b (ip 10.222.0.36) !!! Oct 31 15:10:47.814979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:47.815513 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:47.815979 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:47.816692 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:47.818013 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:47.818450 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:47.822107 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-67a3bec6-feff-425f-9092-cfd99b92b5d5 req-fd04763b-12a6-4df6-b2e5-19c6c9bde97b service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:47.822578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-67a3bec6-feff-425f-9092-cfd99b92b5d5 req-fd04763b-12a6-4df6-b2e5-19c6c9bde97b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:47.823005 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-67a3bec6-feff-425f-9092-cfd99b92b5d5 req-fd04763b-12a6-4df6-b2e5-19c6c9bde97b service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:47.836399 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-67a3bec6-feff-425f-9092-cfd99b92b5d5 req-fd04763b-12a6-4df6-b2e5-19c6c9bde97b service nova] Creating event network-changed:61b79242-a3fb-45f8-8cae-9a795c2147e0 for instance 5d5e18db-c0c5-4201-87d5-890679097b1b on hv-cinder-86022 Oct 31 15:10:47.844551 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-67a3bec6-feff-425f-9092-cfd99b92b5d5 req-fd04763b-12a6-4df6-b2e5-19c6c9bde97b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049338 Oct 31 15:10:47.845161 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 562/1070] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:47.847824 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:10:47.937367 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-37336368-b4e7-431b-b0fc-81253bd7e440 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 204 len: 0 microversion: 2.1 time: 0.145707 Oct 31 15:10:47.939179 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 509/1071] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:10:47 2022] DELETE /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:10:47.948846 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:47.949553 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:47.955860 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:47.956345 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:47.956776 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:47.957473 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:47.958141 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:47.959051 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:48.097842 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:48.106409 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-1592215d-0ce8-48f5-b8a5-4c51994de0fe tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1577 microversion: 2.1 time: 0.162059 Oct 31 15:10:48.107184 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 563/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:47 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:49.131616 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:49.132360 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:49.138988 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:49.139472 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:49.139936 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:49.140635 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:49.141118 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:49.141560 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:49.277563 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:49.285427 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-548ca184-bc91-48f0-8942-0c9dbfb7ed66 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1577 microversion: 2.1 time: 0.158945 Oct 31 15:10:49.286728 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 510/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:49 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:50.290956 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-6a0dce03-e3ff-49f0-bac5-cf0cd0cf960a req-46c2f6c2-6f77-4c36-94e9-04e69c2ffcfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5e18db-c0c5-4201-87d5-890679097b1b", "name": "network-vif-deleted", "tag": "61b79242-a3fb-45f8-8cae-9a795c2147e0"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:50.302559 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-6a0dce03-e3ff-49f0-bac5-cf0cd0cf960a req-46c2f6c2-6f77-4c36-94e9-04e69c2ffcfe service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:50.303034 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-6a0dce03-e3ff-49f0-bac5-cf0cd0cf960a req-46c2f6c2-6f77-4c36-94e9-04e69c2ffcfe service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:50.303744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-6a0dce03-e3ff-49f0-bac5-cf0cd0cf960a req-46c2f6c2-6f77-4c36-94e9-04e69c2ffcfe service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:50.309238 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:50.310758 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:50.318507 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-6a0dce03-e3ff-49f0-bac5-cf0cd0cf960a req-46c2f6c2-6f77-4c36-94e9-04e69c2ffcfe service nova] Creating event network-vif-deleted:61b79242-a3fb-45f8-8cae-9a795c2147e0 for instance 5d5e18db-c0c5-4201-87d5-890679097b1b on hv-cinder-86022 Oct 31 15:10:50.319719 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:50.320547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:50.321305 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:50.322380 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:50.322557 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO oslo.messaging._drivers.impl_rabbit [-] [15957ba2-74d4-4b57-8319-6e896e1f260c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58400. Oct 31 15:10:50.323337 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:50.323792 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:50.324149 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-6a0dce03-e3ff-49f0-bac5-cf0cd0cf960a req-46c2f6c2-6f77-4c36-94e9-04e69c2ffcfe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036795 Oct 31 15:10:50.324744 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 564/1074] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:50.387211 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:50.395408 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-11095f12-ebab-44c9-9d48-4db8395f77d0 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 200 len: 1225 microversion: 2.1 time: 0.090014 Oct 31 15:10:50.396178 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 511/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:50 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:51.418794 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:51.419489 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 5d5e18db-c0c5-4201-87d5-890679097b1b] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:51.425595 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:51.426665 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:51.427136 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:51.427848 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:51.428302 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:51.428731 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:51.441708 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] HTTP exception thrown: Instance 5d5e18db-c0c5-4201-87d5-890679097b1b could not be found. Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Request method failure captured: Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b HTTP/1.1 Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-PWxwYgK4wdMZ-hoChxqRmCVkGYodt-e3PICfWomKUjtDNs2pjFcOuRUmMy0U5v0erf3cRvPQRsxQfbaM-T8a7OCUTuN-DaUDL9sWMiazxjkCT-n4hB6efD5gHUwXLayxltd-Miyz_-8uiMNAsywEY56bUTmiP4IxoVziZUKboKYks Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:10:51.443760 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7f5a9331dd54d9e8b5033234cb1077a"}]}] Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: f0b358738b5a46d8bc1db1da68040c8f Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 5d5e18db-c0c5-4201-87d5-890679097b1b could not be found. Oct 31 15:10:51.445578 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '5d5e18db-c0c5-4201-87d5-890679097b1b'} Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d5e18db-c0c5-4201-87d5-890679097b1b could not be found. Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:10:51.446645 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d5e18db-c0c5-4201-87d5-890679097b1b could not be found. Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d5e18db-c0c5-4201-87d5-890679097b1b could not be found. Oct 31 15:10:51.448456 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:51.450173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Returning 404 to user: Instance 5d5e18db-c0c5-4201-87d5-890679097b1b could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:10:51.450173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-27fc7c65-137a-44be-b4da-a92fca6f4f3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b" status: 404 len: 111 microversion: 2.1 time: 0.030824 Oct 31 15:10:51.450173 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 565/1076] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:51 2022] GET /compute/v2.1/servers/5d5e18db-c0c5-4201-87d5-890679097b1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:10:54.495487 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:54.496512 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:54.496679 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-b13e7254-b51a-4557-a74f-f2acd8454a5b req-0891788a-978a-4549-b19a-4066a718b6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8fb6758-3ce0-4d41-9f6c-60d461c90d66", "tag": "01c6e9f9-8dac-4996-b9c6-53898d243ad8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:54.503670 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.504946 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.505484 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.506275 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.506762 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b13e7254-b51a-4557-a74f-f2acd8454a5b req-0891788a-978a-4549-b19a-4066a718b6af service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.506920 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.507234 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b13e7254-b51a-4557-a74f-f2acd8454a5b req-0891788a-978a-4549-b19a-4066a718b6af service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.507684 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-b13e7254-b51a-4557-a74f-f2acd8454a5b req-0891788a-978a-4549-b19a-4066a718b6af service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.507883 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.519394 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-b13e7254-b51a-4557-a74f-f2acd8454a5b req-0891788a-978a-4549-b19a-4066a718b6af service nova] Creating event network-changed:01c6e9f9-8dac-4996-b9c6-53898d243ad8 for instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 on hv-cinder-86022 Oct 31 15:10:54.525962 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-b13e7254-b51a-4557-a74f-f2acd8454a5b req-0891788a-978a-4549-b19a-4066a718b6af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032706 Oct 31 15:10:54.526750 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 566/1077] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:54.544194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Going to try to terminate instance {{(pid=134338) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:10:54.632724 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-b7331b4a-8155-46b8-942c-2f33b0ca6b7f tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 204 len: 0 microversion: 2.1 time: 0.141182 Oct 31 15:10:54.635273 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 512/1078] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:10:54 2022] DELETE /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:10:54.643322 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:54.644395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:54.652252 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.653091 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.653715 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.654713 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:54.655362 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:54.655976 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:54.807705 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.policy [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134339) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:54.816434 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-6af7f30f-4470-45ac-95c9-ee2b35c619a6 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1577 microversion: 2.1 time: 0.177183 Oct 31 15:10:54.817941 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 567/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:54 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:55.842740 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:55.843445 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:55.850445 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:55.850919 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:55.851356 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:55.852075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:55.852528 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:55.852949 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:56.034399 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:56.043390 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-14df884a-3370-4869-930e-71eba1add0e4 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1577 microversion: 2.1 time: 0.204896 Oct 31 15:10:56.044000 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 513/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:55 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:56.559263 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [req-19b149cd-b1a4-46ea-9f08-2d65f7f12ee9 req-67217c40-1102-47fa-8f8e-cbc827c71f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fb6758-3ce0-4d41-9f6c-60d461c90d66", "name": "network-vif-deleted", "tag": "01c6e9f9-8dac-4996-b9c6-53898d243ad8"}]} {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:10:56.573282 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-19b149cd-b1a4-46ea-9f08-2d65f7f12ee9 req-67217c40-1102-47fa-8f8e-cbc827c71f62 service nova] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:56.573848 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-19b149cd-b1a4-46ea-9f08-2d65f7f12ee9 req-67217c40-1102-47fa-8f8e-cbc827c71f62 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:56.574343 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [req-19b149cd-b1a4-46ea-9f08-2d65f7f12ee9 req-67217c40-1102-47fa-8f8e-cbc827c71f62 service nova] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:56.590413 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.compute.server_external_events [req-19b149cd-b1a4-46ea-9f08-2d65f7f12ee9 req-67217c40-1102-47fa-8f8e-cbc827c71f62 service nova] Creating event network-vif-deleted:01c6e9f9-8dac-4996-b9c6-53898d243ad8 for instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 on hv-cinder-86022 Oct 31 15:10:56.596438 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [req-19b149cd-b1a4-46ea-9f08-2d65f7f12ee9 req-67217c40-1102-47fa-8f8e-cbc827c71f62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040421 Oct 31 15:10:56.597092 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 568/1081] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 31 15:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:10:57.067359 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:57.067950 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:57.074281 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:57.074757 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:57.075186 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:57.075909 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:57.076358 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:57.076775 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:57.115500 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:57.116105 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:57.116544 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:57.116999 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.objects.instance [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lazy-loading 'fault' on Instance uuid a8fb6758-3ce0-4d41-9f6c-60d461c90d66 {{(pid=134338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:10:57.168682 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.policy [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b358738b5a46d8bc1db1da68040c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f5a9331dd54d9e8b5033234cb1077a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134338) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:10:57.178292 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-a56208ab-be0b-49ef-94cb-a01affba07a7 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 200 len: 1231 microversion: 2.1 time: 0.115283 Oct 31 15:10:57.178874 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 514/1082] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:57 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 1231 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:10:58.202331 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:58.203024 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: a8fb6758-3ce0-4d41-9f6c-60d461c90d66] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:58.210492 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:58.210966 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:58.211395 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:58.212108 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:58.212553 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:58.212969 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:58.226741 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] HTTP exception thrown: Instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 could not be found. Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Request method failure captured: Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 HTTP/1.1 Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-PWxwYgK4wdMZ-hoChxqRmCVkGYodt-e3PICfWomKUjtDNs2pjFcOuRUmMy0U5v0erf3cRvPQRsxQfbaM-T8a7OCUTuN-DaUDL9sWMiazxjkCT-n4hB6efD5gHUwXLayxltd-Miyz_-8uiMNAsywEY56bUTmiP4IxoVziZUKboKYks Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:10:58.228356 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7f5a9331dd54d9e8b5033234cb1077a"}]}] Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: f0b358738b5a46d8bc1db1da68040c8f Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 could not be found. Oct 31 15:10:58.230181 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': 'a8fb6758-3ce0-4d41-9f6c-60d461c90d66'} Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 could not be found. Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:10:58.231105 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 could not be found. Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 could not be found. Oct 31 15:10:58.232780 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.234423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Returning 404 to user: Instance a8fb6758-3ce0-4d41-9f6c-60d461c90d66 could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:10:58.234423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-59c63da3-1618-4017-bfc4-889cc4d0042a tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66" status: 404 len: 111 microversion: 2.1 time: 0.031533 Oct 31 15:10:58.234423 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 569/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:58 2022] GET /compute/v2.1/servers/a8fb6758-3ce0-4d41-9f6c-60d461c90d66 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:10:58.663194 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:58.663787 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.compute.api [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134338) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:58.670152 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:58.670643 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:58.671075 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:58.671770 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:58.672214 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:58.672627 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG oslo_concurrency.lockutils [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:58.686170 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.wsgi [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] HTTP exception thrown: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Request method failure captured: Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: request: DELETE /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f HTTP/1.1 Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept: application/json Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Accept-Encoding: identity Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Connection: close Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Length: 0 Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Content-Type: application/json Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Host: 10.222.0.36 Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: Openstack-System-Scope: None Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: User-Agent: python-urllib3/1.26.12 Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Auth-Token: gAAAAABjX-PWxwYgK4wdMZ-hoChxqRmCVkGYodt-e3PICfWomKUjtDNs2pjFcOuRUmMy0U5v0erf3cRvPQRsxQfbaM-T8a7OCUTuN-DaUDL9sWMiazxjkCT-n4hB6efD5gHUwXLayxltd-Miyz_-8uiMNAsywEY56bUTmiP4IxoVziZUKboKYks Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Id: None Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Domain-Name: None Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Identity-Status: Confirmed Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Is-Admin-Project: True Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Id: default Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Domain-Name: Default Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Project-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Role: reader,member Oct 31 15:10:58.687836 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Roles: reader,member Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7f5a9331dd54d9e8b5033234cb1077a"}]}] Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-Tenant-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Id: default Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Domain-Name: Default Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Id: f0b358738b5a46d8bc1db1da68040c8f Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: X-User-Name: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: method: > Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: exception: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.689547 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: action_args: {'id': '95baeb64-0d66-4688-8450-ce141151856f'} Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:10:58.690430 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.692671 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.694182 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Returning 404 to user: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. {{(pid=134338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:10:58.694182 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-478fcd8f-42e7-4615-a2c4-f0c9e3c632a1 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "DELETE /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 404 len: 111 microversion: 2.1 time: 0.029863 Oct 31 15:10:58.694182 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 515/1084] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 31 15:10:58 2022] DELETE /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:10:58.698592 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '>' {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:10:58.699205 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.compute.api [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] [instance: 95baeb64-0d66-4688-8450-ce141151856f] Fetching instance by UUID {{(pid=134339) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:10:58.705104 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:58.705577 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:58.706006 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:58.706679 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Acquiring lock "9d73f737-e281-44b5-9222-e10716a9638b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:10:58.707733 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:10:58.708150 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG oslo_concurrency.lockutils [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Lock "9d73f737-e281-44b5-9222-e10716a9638b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:10:58.721170 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.wsgi [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] HTTP exception thrown: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Request method failure captured: Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: request: GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f HTTP/1.1 Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept: application/json Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Accept-Encoding: identity Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Connection: close Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Length: 0 Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Content-Type: application/json Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Host: 10.222.0.36 Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: Openstack-System-Scope: None Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: User-Agent: python-urllib3/1.26.12 Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Auth-Token: gAAAAABjX-PWxwYgK4wdMZ-hoChxqRmCVkGYodt-e3PICfWomKUjtDNs2pjFcOuRUmMy0U5v0erf3cRvPQRsxQfbaM-T8a7OCUTuN-DaUDL9sWMiazxjkCT-n4hB6efD5gHUwXLayxltd-Miyz_-8uiMNAsywEY56bUTmiP4IxoVziZUKboKYks Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Id: None Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Domain-Name: None Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Identity-Status: Confirmed Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Is-Admin-Project: True Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Id: default Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Domain-Name: Default Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Project-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Role: reader,member Oct 31 15:10:58.722727 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Roles: reader,member Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7f5a9331dd54d9e8b5033234cb1077a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7f5a9331dd54d9e8b5033234cb1077a"}]}] Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Id: d7f5a9331dd54d9e8b5033234cb1077a Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-Tenant-Name: tempest-TestVolumeBootPattern-530201108 Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Id: default Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Domain-Name: Default Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Id: f0b358738b5a46d8bc1db1da68040c8f Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: X-User-Name: tempest-TestVolumeBootPattern-530201108-project Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: method: > Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: exception: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.724445 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: action_args: {'id': '95baeb64-0d66-4688-8450-ce141151856f'} Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: {{(pid=134339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:10:58.725452 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. Oct 31 15:10:58.727183 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: ERROR nova.api.openstack.wsgi Oct 31 15:10:58.728820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: DEBUG nova.api.openstack.wsgi [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Returning 404 to user: Instance 95baeb64-0d66-4688-8450-ce141151856f could not be found. {{(pid=134339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:10:58.728820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: INFO nova.api.openstack.requestlog [None req-a0167e20-1b77-4b6b-86e3-aa47bca1ca3c tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f" status: 404 len: 111 microversion: 2.1 time: 0.029245 Oct 31 15:10:58.728820 dv-cinder-860227-3-iscsi devstack@n-api.service[134339]: [pid: 134339|app: 0|req: 570/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 31 15:10:58 2022] GET /compute/v2.1/servers/95baeb64-0d66-4688-8450-ce141151856f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:11:00.016814 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: DEBUG nova.api.openstack.wsgi [None req-d7a02403-6aac-46aa-a218-480f6d727331 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] Calling method '.version_select at 0x7f6c70fb8160>' {{(pid=134338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:11:00.042868 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: INFO nova.api.openstack.requestlog [None req-d7a02403-6aac-46aa-a218-480f6d727331 tempest-TestVolumeBootPattern-530201108 tempest-TestVolumeBootPattern-530201108-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2106455873" status: 202 len: 0 microversion: 2.1 time: 0.029852 Oct 31 15:11:00.043720 dv-cinder-860227-3-iscsi devstack@n-api.service[134338]: [pid: 134338|app: 0|req: 516/1086] 10.222.0.36 () {58 vars in 1263 bytes} [Mon Oct 31 15:11:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2106455873 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)